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is  developed  and  a  general  algorithm  for  finding  an  optimal  integer  solution  is 
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when  the  integer  restriction  is  removed,  the  general  algorithm  reduces  to  an 
algorithm  proposed  by  Isbell  and  Marlow  to  solve  the  continuous  hyperbolic  program. 
It  is  also  shown  that  the  group  theoretic  approach  to  integer  programming  can  be 
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also  given.  It  is  shown  that  using  the  general  algorithm  to  solve  these  problems 
makes  it  possible  to  reduce  the  number  of  variables  at  each  Iteration. 
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ABSTRACT 


The  problem  considered  is  that  of  finding  an  optimal  integer  solution 
for  the  hyperbolic  programming  problem.  A  geometrical  framework  Cor  viewing 
the  problem  is  developed  and  a  general  algorithm  for  finding  an  optimal 
integer  solution  is  proposed.  This  algorithm  reduces  to  solving  a  finite 
sequence  of  linear  integer  programs  when  the  number  of  feasible  integer 
pointB  la  finite.  It  is  shown  that  when  the  Integer  restriction  is  removed, 
the  general  algorithm  reduces  to  an  algorithm  proposed  by  Isbell  and  Marlow 
to  solve  the  continuous  hyperbolic  program.  It  Is  also  shown  that  the  group 
theoretic  approach  to  integer  programming  can  be  used  for  hyperbolic  Integer 
programming.  Solutions  for  a  hyperbolic  programming  problem  with  bounded 
Integer  variables  only  and  a  hyperbolic  knapsack  problem  are  also  given. 

It  is  shown  that  using  the  general  algorithm  to  solve  these  problems  makes 
it  possible  to  reduce  the  number  of  variables  at  each  iteration. 
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CHAPTER  1 


INTRODUCTION 

1.1  The  Hyperbolic  Programming  Problem  and  Ita  Origins 

Mathematical  programs  whose  objective  functions  can  be 
expressed  as  ratios  of  functionals  are  commonly  called  fractional 
programs.  A  special  case  belonging  to  this  class  of  problems  is 
the  hyperbolic  programming  problem. ^  It  has  an  objective  function 
which  is  the  ratio  of  linear  functionals  and  is  of  the  following  form! 

max  (f(x')  ■  (c/x'  +  a)/(d'x'  +  0)} 
b.  t.  A'x'  ^  b 

x'  >  0  (Vp 

To  avoid  pathological  ca^es,  it  will  bo  assumed  that  (P^)  is  defined 
over  the  field  of  rationals.  The  constraint  matrix  A’  has  dimension 
(m  x  n)  ,  x'  in  on  n  dimensional  column  vector,  c  '  and  d_'  ore  n 
dimensional  row  vectors,  b  is  an  m  dimensional  column  vector  and  a  and 
(5  are  fixed  conntnnts. 

Applications  of  (P^,)  arise  in  a  wide  variety  of  contexts. 
Alinogy  and  l.evin  [1]  note  that  a  fractional  objective  function  can 
represent  a  time  rate  of  earnings  and  la  therefore  a  true  mo  a  hi- re  of 
economic,  performance.  Martos  [2]  recognizes  the  approprinl'etvfiH  of 

^  Tills  problem  is  also  known  us  tho  linear  fractional 
programming  problem. 
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the  structure  of  (P^)  when  the  purpose  of  optimization  is  finding  the 
most  favorable  ratio  of  revenues  and  allocations, 

Dantzig  at  al.  [3]  construct  a  hyperbolic  program  when  solving 
a  ship  routing  problem.  Their  solution  requires  finding  a  cycle  in  s 
graph  which  has  a  minimal  cost  to  time  rati.-.  This  problem  was  alno 
studied  by  Fox  [4], 

Production  models  in  which  the  manufacturing  processes  generate 
scrap  material  also  suggast  problems  that  resemble  (P^) .  For  example, 
in  their  discussion  of  the  cutting  stock  problem,  Gilmore  and  Gomory 
(5]  minimize  a  rational  objective  function  which  represontn  percentage 
waste,  Wagner  [6]  considers  the  related  problem  of  finding  the 
production  schedule  which  mtximiz.es  the  fraction  of  usable  raw 
material , 

Charnes  and  Cooper  [7]  generate  (1*^)  when  dealing  with  system 
evaluation  and  repricing  problems.  In  thin  context,  the  objective 
function  is  the  ratio  of  the  total  change  in  cost  to  changes  i '■  volume 
tliot  accompany  possible  variations  of  n  particular  coat  coefficient:. 

Other  applications  arise  in  the.  arena  of  optimal  maintenance 
of  equipment  [B],  Markov  renewal  programming  [9],  and  routing 
p rob ,1  phis  [1], 

The  solution  to  (P')  is  well  docume.nl.ud  and  in  briefly  i,ev!ew,,d 
in  Chapter  2.  Although  the  more  general  fractional  programming  pro¬ 
blem  ie  not  considered  hove,  it  hna  also  received  considerable 
attention.  Dlnknlhach  [10]  studied  convex-concave  ration,  Hector 
[11]  recognized  those  ratios  which  are  convex,  and  Msngnmirlnn  [12] 
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noted  that  undue  certain  restrictions  the  Prank  and  Wolfe  algorithm 
can  be  used  to  optimize  a  convex-concave  ratio.  A  bibliography  on 
fractional  programming  can  be  found  in  Grunspen  [13). 


1.2  Hyperbolic  Programming  VM_th_ Integer  Vorlahleg 

Integer  variable  restrictions  ate  just  as  important  in 
hyperbolic  programming  formulations  as  in  linear  programming  ^ 

For  example,  consider  an  investor  faced  with  the  problem  of  determining 
how  many  shaves  in  each  of  n  investments  he  should  purchase  at  the 
beginning  of  a  time  period  so  that  at  the  end  of  tire  time  period,  the 
ratio  of  his  holdings  to  hit)  cost  is  a  maximum.  Assuming  that  the 
constraints  on  the  fund?  available  for  investment  are  linear  inequali¬ 
ties  and  lotting 

Cj-v«lua  of  one  share  of  investment  i  at  end  of  time  period 

d^-coat  of  one  share  of  investment  i  at:  beginning  of  Lime 
period . 

a-guaranteed  return 

h-flXKl  COHt 

x^-number  of  shams  of  investment.  1 

the  optimal  invu'itment  policy  can  be  obtained  by  solving  the  following 
problem! 


Keonoinl c  niuilymn  problems  which  ileal  with  Indivisible 
eommodl t f an  arc  nlviiyn  muo  real  1  at  ienlly  formulated  ac  hHegc 
pi  ogramn .  A  wealth  of  other  exampl  an  can  he  found  In  Hal  1  link  I  [)/i]. 


;l 


max  (f(x')  -  (  l  c!xj  +  u)/(  l  +  0)} 

i**l  1  i“l 

s .  t .  A'x 1  £ 

x'  >_  0  and  integer. 

Certain  routing  problems  where  the  objective  Is  to  minimize 
the  cost  to  time  ratio  can  also  be  formulated  as  hyperbolic  integer 
programs  [1], 

Dantzlg  [15]  has  shown  that  integer  variables  nl.no  arise 
indirectly.  For  example,  the  condition  that  a  variable  x  can  only 
assume  one  of  a  discrete  set  of  values  can  easily  be  expressed  with 
the  aid  of  (0-1)  variables.  Integer  variables  of  the  (0-1)  type  arc 
also  useful  when  it  is  necessary  to  express  the  condition  that:  only  U 
out  of  m  eouBtrnl  nta  must  be  satisfied. 

The  importance  of  the  integer  restriction  in  hyperbolic 
programming  leads  to  problem  (!*',)  with  the  additional  restriction  that 
the  solution  vector  x'  ho  nil  integer.  This  problem  will  bo  denoted 
by  (1'j).  Since  (P^,)  Is  defined  over  t:bo  field  of  ratloimls,  there  la 
no  loss  In  generality  In  assuming  that.  In  (1’j)  the  entries  In  A', 
n*  and  d'  mid  b  an  well  as  the  fixed  const  ants  o  and  !J,  art*,  all  integer 

An  alternate  formulation  fen  (I'j)  is  obtained  by  adding  slack 
variables  to  the  const  mint  equations.  This  lends  to  a  problem  in 
a  space  of  higher  dimension  which  is  of  t  ho  following  form: 

max  If  (x)  (ci  £  +  a)/(d  _x_  •!■  I'.) } 
e .  t .  Ax  ,a  h 

(•’,) 


x  >  0  end  Integer 
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Xn  this  formulation  A  is  an  m  x  (m  4-  n)  integer  matrix,  5t  is  an 
(tn  +  n)  dimensional  integer  column  vector,  c  and  ar<i  (m  4-  n) 
dimensional  integer  row  vectors,  b_  is  an  m  dimensional  Integer  column 
vector  and  a  and  B  are  fined  integers. 

Problems  (l’j)  and  (l’p  are  alternate  statements  of  the  general 
hyperbolic  integer  programming  problem.  Solving  (Pj)  ia  equivalent  to 
solving  (P,|).  The  objective  of  this  dissertation  1b  to  develop  a 
class  of  algorithms  for  finding  the  optimal  solutions  for  (Pj.)  or 
(P{). 

Throughout  the  remainder  of  this  paper,  it  will  be  assumed 
that  the  set  of  feasible  solutions  for  (Pj)  is  bounded  and  that  the  value 
of  the  denominator  in  the  objective  function  1b  strictly  greater  than 
zero  for  all  fcmvihle  solutions.  These  assumptions  arc  quite  realistic 
in  an  economic  context.  Respectively  they  Imply  that  the  levels  of 
activities  being  programmed  cannot  be  unbounded  and  that  the  objective 
function  value  cannot  become  infinite. 


CHAPTER  2 


CONTINUOUS  HYPERBOLIC  PROGRAMMING 

2 .1  The  Isboll-Marlow  A 1  _g orithm 

The  general  algorithm  discussed  in  Chapter  3  can  be  viewed  as 

a  generalization  of  an  algorithm  originally  proposed  by  Isbell  and 

Marlow  [16]  for  solving  the  continuous  hyperbolic  program.  To 

motivate  the  presentation  which  follows,  it  will  be  useful  to  review 

the  central  idea  behind  this  algorithm.  Let  X/  «  {x*  |a'x'  <_  t^,x'  j^O}, 

and  let  x'  be  any  point  such  that  (d'x'  +  B)  i  0.  First  suppose  that 

the  point  x'  is  feasible  for  (P'}  and  consider  the.  following  linear 
fit  C 

programming  problem: 


max  { z (x 1 )  *  (d'x1  +  0)(c'x'  +  a)  -  (c'x1  +  a)(d'x'  +  B) } 
“  —  —a  —  —  —  —a  —  — 


s.t.  x'  e  X' 


Since  the  point  x^  is  feasible  for  this  problem,  it  follows  that 

max  2(x/)  2L  0*  Thus  if  is  an  optimal  solution  for  the  linear 
x'  c  X' 

program,  the  condition 


z(x!)  «  (d'x'  +  B)(c'x]  +  o)  -  (c'x*  +  a)(d'x!  +  B)  >  0 
“1  —  —a  - 1  - a  - X  ~ 


together  with  the  assumption  that  (.d’x/  +  3)  >  0  Vx.'  e  X'  implies 
that 

(jt'x^  +  a)  (c'x  ’  +  a) 

f  &l>  “  WTT)  -  W'  +  l y  “  C(*a} 
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Hence 'given  a  feasible  point  x^  for  (P^,),  It  is  always  possible  to  \ 
formulate  a  linear  program  whose  solution  yields  an  objective  function 
value  for  (P’>  which  is  at  least  as  good  as  £(x*). 

w  » 

Interestingly  enough,  even  if  x/  is  not  feasible  for  (P^,)  ,  the 

i 

solution  to  the  j 'near  program  is  still  feasible  for  (Pi).  In  this 

i  !  L 

case  however,  it  is  possible  that  f(xl)  <  f(x').  Since  xV  is  not 

x  a  \ 
feasible,  this  lc'  of  no  consequence.  The  important  thing  Is  that  it 

a  feasible  point  is  not  immediately  available,  one  can  always  be 

obtained  by  solving  a  linear  program.  Once  a  feasible  point  is  at 

nand,  it  is  possible  to  formulate  a  second  linear  program  which  yields 

an  objective  function  value  for  (P*)  which  is  at  least  bb  good  as 

thp  current  value. ^  Independent  of  the  feasibility  of  x^ ,  the  existence 

of  a  finite  solution  for'j  the  linear  program  is  insured  if  X'  is 

assumed  bounded .  ^  \ 


\  The  result  of  this  analysis  ia  the  I  She.  11-Mar  low  algorithm. 

It  is  a  procedure  for  solving  (P’)  which  reduces  to  solving  a  finite 

^  i  ’ 

sequence  of  linear  programming  problems. 


2 . 2  An  Extension  of  the  Isbell -Mat' low  Algorithm 

\ 

In  this  section,  it  will  be  show's  that  hyperbolic  programming 

problems  other  than  (P*)  can  be  solved  using  an  approach  similar  to 

L  \ 

the  one  described  in  Section  2.1. 

I  i 

Consider  the  problem 

I 

max  tf(x')  ■  (.c'x'  +  a)/(d'x'  -PS)} 

l 

s.t.  \x*  c  F  (Pi) 

r  * 


SIMM ..  ,.}.f 

< VvS iriv. a -v,  i.i h i j 'i\v f ,>•».(  v'l Ai 
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\ 

where  the  feasible  set  F  consists  of  a  finite  number  of  points, 

l 

Repeating  the  argument  used  to  develop  the  Xebcll-Marlow  algorithm  \ 
for  (P * ) ,  if  x'  is  any  feasible  point  for  (Pi),  then  an  improved 

v  *  0  4 

solution  for  (Pi)  can  be  obtained  by  considering  the  following 

E  • 

problem: 

max  { 2 (x * )  ■  (d'x1  +  0)(c'x'  +  a)  -  (c'x*  +  a)(d*x'  +  (5)} 

~  —a  —  —  —  —a  - -  i 

s.t,  x'  e  F  1  (LP ',) 

r 

\ 

The  next  theorem  gives  a  necessary  and  sufficient  condition  f^r  the 

point  x'  to  be  optimal  for  (Pi) . 

-a  *  \ 

i 

Theorem  1 


The  point  x^  e  F  maximizes  the  hyperbolic  objective  function 
)in  (Pp  iff  f  F  maximizes  the  objective  function  in  (l.Pp . 

Proof: 


First  suppose  that 


max  fix')  »  f(x') 
*~a 

X '  E  F 


(2.1) 


Assuming  that  (d/x'  +  g)  >  0  Vx^'  c  F,  (2.1)  implies  that 


<d'x'  +  B)(c'x'  +  a)  -  (c'x'  +  a) (d'x*  +  g)  <0  Vx'  c  F 

fl\  °  (2.2) 

The  left-hand  side  in  (2.2)  is  cleatly  the  objective  function  in  (LPp), 

P<>  inspection,  it  achieves  its  upper  bound  at  the  point  x.' ..  The  point 

x^  is  therefore  optimal  for  (LPp. 
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To  prove  the  second  part  of  the  Theorem.,  suppose  that 

max  { c (x ' ) }  “  0 

s.t.  x*  k  F 

This  implies  that 

e(x')  .1  0  Vx'  e  F 

! 

Since  (d'x*  +  0)  >  0  Vx'  e  F,  the  above  inequality  implies  that 

f(x')  <  f (V)  Vx'  e  F 

—  — g  — 

The  point  x^  is  therefore  an  optimal  solution  for  (Fp. 

Corollary  1 . 1 

The  point  x^  which  maximizes  (LPp  la  optimal  for  (vp  iff 
z(xp  -  0. 

Proof : 

This  result  Is  a  direct  consequence  of  the  proof  given  for 
Theorem  1 , 

Theorem  1  and  Corollary  1.1  together  with  the  observation  that 

max  7.  (x ' )  £  0  suggest  m  that  the  solution  to  (l‘p  can  he  obtained  by 
x'  c  F 

solving  a  finite  sequence  of  linear  optimization  problems. 

2.3  Alternate  Solution  Approaches  for  (pp 

Given  that  (d ' x'  +  G)  >  0  Vx/  t  X' ,  Mnrton  [?.]  proved  that 
the  solution  to  (P'j  must  lie  on  at  Jonat  one  extreme  point  of  the 

v 


SS_ 


,tSwtt^&r$t!A^r*‘rz™ 


i-ira  istf  ■j.ry 
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feauible  oet  K" .  Based  on  this  result*  he  developed  an  extreme  point 
search  very  similar  to  the  simplex  algorithm  of  linear  programming. 

The  Martos  algorithm  is  fundamental  to  the  cutting  plane  methods 
discussed  in  Chapter  3.  It  will  he  reviewed  later  as  part  of  the 
development  for  the  cutting  plane  algorithms. 

Another  approach  for  solving  (P*)  which  1b  in  the  spirit  of 

Vi 

Lsmke's  dual  simplex  algorithm  is  due  to  Dorn  (17),  In  this  algorithm 
it  is  important  that  the  original  problem  be  treated  as  the  dual 
problem.  An  extreme  point:  of  the  dual  feasible  set  (the  original 
feasible  act)  ia  chosen  and  the  current  values  of  the  primal  variables 
(the  Lagrange  multipliers)  are  computed.  If  they  all  have  the  proper 
sign,  the  current  solution  is  optimal,  If  thoy  do  not,  an  adjacent 
extreme  point  of  the  dual  feasible  set  which  improves  the  objective 
function  value  in  chosen  and  the  procedure  is  repeated.  Since  the  dual 
feasible  region  has  «  finite  number  of  extreme  points  and  nines  a 
local  maximum  for  (Pp  is  also  «  global  ma:  4 mum,  the  algorithm 
terminate:'!  in  a  finite  number  ef  steps.  Dorn  also  points  out  that  the 
pvobk'iN  of  finding  an  initial  extreme  point  solution  and  of  degeneracy 
are  identical  with  those  same  problems  for  linear  programs.  Remedies 
for  these  problems  can  be  found  in  the  appendices  of  (18). 

Another  alternative  for  solving  (Pp  Is  proposed  by  Cbarneu 
end  Cooper  (19).  By  means  of  a  simple  transformation,  the  hyperbolic 
program  is  transformed  to  u  linear  program.  If  the  sign  of  the 
objective  function  value  is  known  at  optimality,  only  and  linear 
program  need  be  solved.  Otherwise,  it  is  necessary  to  solve  two 
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linear  programs,  Unfortunately,  due  to  the  nature  of  the  transforma¬ 
tion,  finding  the  integer  solution  to  the  CharneB  and  Cooper  linear 
program  does  not  guarantee  that  the  integer  solution  to  (P^,)  la 
directly  available. 

2.4  The  Geometry  of  the  Hyperbolic  Program 

This  section  is  devoted  to  the  geometrical  aspecto  of  hyperbolic 
programming.  The  ideas  developed  here  will  also  be  useful  in  describing 
geometrically  the  algorithms  in  Chapter  3. 

Corresponding  to  any  sequence  of  hyperbolic  functional  values 
{f (x|) , . . . ,f (x^) }  with  the  property  that  x^  c  X'  Vi  and  f(xj)  f-  f 
(i*»l, . . . ,n»l)  there  is  a  unique  sequence  of  hyperplanes  {T°,..,,T°} 
where 

T°  "  { x.'  |  (d'x.|  +  B)(cV  +  a)  -  (c/ x|  +  cOCi'x’  +  B)  °  0} 

i-l,...,n  (2.3) 

Tfa  hype  rplanc.s  T°  can  bo  scan  to  intersect  about  the  solution  set  of 
the  following  set  of  equations! 

c'x'  .+  a  *  0 

d  V  +  a  «  0  (2.4) 

The  solution  set  for  (2.4)  also  the  act 

k-Jicn(T)  "  {x'  !  (c\x'  +  o  »  0,  +  B  «  0,  x1  t  Kn) 

which  is  the  kernel  cf  the  map  defined  by 

T ( x 1 )  ( c ' x ’  +  a  ,  d'x'  +  a)  x'  c  F.n 
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The  first  component  of  the  image  of  x*  under  the  map  T  corresponds  to 
the  numerator  and  the  second  component  corresponds  to  the  denominator 
of  the  hyperbolic  objective  function. 

Having  introduced  the  set,  kcrn(T),  a  foundation  for  the 
geometric  description  of  the  behavior  of  the  hyperbolic  objective 
function  in  En  is  developed. 

A  trivial  hyperbolic:  program  occurs  va.en  the  functionals 
(c'x1  +  a)  and  (d'x'  +  3)  are  linearly  dependent.  It  is  easy  to  see 
that  for  Buch  a  problem,  the  objective  function  value  remains  constant 
Vx'  c  En.  To  avoid  this  case,  it  viill  always  be  assumed  that 
(c’x'  4  u)  and  (d/x1  4  B)  are  linearly  independent.  This  assumption 
also  injures  that  the  Bet  kern(T)  is  nonempty. 

T  emrna  1 

The  set  kern(T)  j*  41  if  the  functional  (c/x'  +  a)  is  linearly 
Independent  of  the  functional  (d/x'  4  g). 

Proof: 

Thlb  result  is  a  consequence  of  the  fact  *  hat  the  tn tip  T  is 
onto  if  (.c'x.'  +  ct)  and  (d'x’  4  B)  are  linearly  independent ,  Suppose 
Cy j  * y 2 ^  f  E  is  chosen  arbitrarily.  Thu  map  T  is  onto  if  there  exist 
x’  r.  lin  such  that 

y.  »  c’x'  4a 

x  *  '  *~V(  « 

y2  **  d'xj,  4  3 

The  oxlstei.ee  of  a  point  follows  from  the  linear  independence 
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assumption.  A  point  can  be  obtained  by  arbitrarily  setting  the 
levels  of  (n-2)  of  the  variables  and  solving  for  the  remaining  two. 

The  map  T  la  therefore  onwo  and  it  follows  that  kern(T)  i  4>. 

Thus  far,  based  on  tha  assumptions  made  about  (P^)* 
kern(T)  •  $  and  X'  1*  <t.  With  the  additional  assumption  that 
(d/x/  +  B)  >  0,  it  also  follows  that  kern(T)  n  X'  ■  <t>. 

Lemma  2 

When  (d/x*  +•  0)  >  0  Vx(  e  X',  the  set  kern(T)  together  with 
any  x^  t  X'  define  a  hyper plane  T°  in  En. 

Proof  1 

A  well  knownresult  from  linear  algebru  states)  that  if 
Titin  -*■  Em,  dim  ketn(T)  +  dim  range  (T)  *  n.  In  particular  when  m=2, 
kern(T)  la  an  (n-2)  dimensional  subnpace  of  En,  With  the  assumptions 
made  thus  far,  kern(T)  n  X*  »  4>.  Hence  any  point  x_'  c.  X*  is  linearly 
independent  of  any  point  belonging  to  kern(T)  and  any  basis  for 
kern(T)  together  wi  th  x^  span  an  (n-1)  dimensional  uubspace  of  K 
Hy  definition,  this  is  a  hyparplonu  in  Kn.  Recalling  the  definition  of 
T  given  in  (2.3),  it  in  clear  that  in  addition  to  the  point  _x' ,  every 

fl  “'fl 

point  in  the  set  kcrn(T)  lies  on  the  hyperplane  T°.  Hence  korn(T) 
together  with  e  X'  define  T°.  Thin  proven  the  Lemma. 

Lemma  2  provides  the  tool,  for  showing  that  a  change  in  the  hyperbolic 
objective  function  value  can  be  achieved  by  a  rotation  of  about 

kern(T).  To  see  that  this  is  indeed  the  case,  recall,  that  given  a  ! 

I 

I 

I 

f 


sequence  {f  (xp  , . . .  ,f  (x^)}  with  x|  e  X*  Vi  and  £  (x j)  <  f(x.[+^) 

(i-li . . . ,n-l)  there  exist  a  unique  corresponding  sequence  {T°,.,.,T°}. 
Appealing  to  Lemma  2,  note  that  together  with  kern(T)  define  T° 
and  together  with  kern(T)  define  T°+^ .  Furthermore,  by  definition 

of  the  hyperplane 

Ti  n  Ti+1  “  kern(T) 

Since  the  functional  values  f(x^)  and  £(x|^)  are  achieved  with  points 
that  lie  on  intersecting  hyperplanes,  and  since  it  was  originally 
assumed  that  x^  e  X'  Vi  and  f  (xj)  <  f  ^  *  tkc  desired  conclusion 
follows. 

To  clarify  the  exposition  In  this  section,  consider  the 
following  problem! 

max  {f(xj,xp  «  (cjxj  +  C2X2  +  «)/(djx|  +  d^x^  +  d)) 
a.t.  «]xxj  +  «;2x^  <  bx 

a21*2  +  a22x2  --  b2 
*i,x*  >.  o 

To  avoid  problems  which  need  special  attention,  it  is  anaumed  that 
the  feasible  region  is  bounded,  that  numerator  and  denominator  in  the 
objective  function  are  linearly  independent  und  that 
(djxj  +  d^x^,  +  B)  >  0  for  all  feasible  points. 

Baaed  on  the.  geometrical  aspects  of  this  problem,  elements  of 
the  out  korn(T)  are  also  solutions  of  the  system 
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^1*1  C2x2  a  "  0 

djXj  +  d 2  +  f3  *  0  (2.5) 

From  the  linear  independent  assumption,  the  solution  to  (2.5)  is 

2 

unique  and  therefore.  kern(T)  is  n  singleton  sot  In  E  .  The  assumption 

that  (d^xj^  +  ^2x2  +  >  ^  for  ^et  1  ' !  points  implies  that  kern(T) 

and  the  feasible  region  are  mutually  eXt .^sive  seta,  Appealing  to 
Lemma  2t  kern(T)  together  with  any  feasible  point  x*  define  a  hyper- 

1  o 

plane  T°.  This  is  illustrated  in  Figure.  1.  The  optiivl  objective 

function  value  for  this  sample  problem  is  obtained  by  rotating  T°  about 

« 

kr.rn(T).  Examining  Figure  1,  it  cun  be  seen  that  the  optimal  hyper¬ 
bolic  solution  far  this  problem  must  lie  on  nt  least  one  of  the  extreme 
points  of  the  feasible  act.  (See  Theorem  2  ), 

Before  proceeding  to  the  integer  solution  of  the  hypurbnli e 
programming  problem,  it  will  be  useful  to  examine  the  Isbell -Marlow 
algorithm  within  the  framework  developed  hero.  First  a  poJn*  x*  such 
that  (d’x'  +  |3)  i1  0  in  chosen  and  a  foaulhle  point  x!  which  maximizes 

(d '  x 1  +  0 )  ( c '  X '  +  a)  (c'x'  +  u)(d'x'  T  lO 

—*  ""*U  “  ’  ‘  '  ■"« 

is  obtained  by  solving  a  llnoitr  programming  problem.  If  the  hyperplnnc 
Tj  la  a  supporting  hyperplm.;<  to  the  fonalt'ie  region,  the  point  xj 
is  optima .1  for  (P^,).  If  xj  la  not  optimal,  a  point  xl,  which  mnxlml zen 

(d’x  j  +  p)  (c'x 1  T  u)  -  (c'xj  +  ,J,)(d'x'  i  lO 

is  obtained.  If  T°  ia  a  supporting  by per pi  nun  to  the  femilhle  region, 
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3t\  Is  optimal*  If  it  is  nott  tl>,e  procedure  i*4  repeated*  The 
Workings  of  the  Isbell-Mat  low  algorithm  are  demonstrated  with  an 
example  in  two  variables  in. Figure  2* 

Based  ot»  the  geometrical  analysis  of  (P* ) ,  the  most  immediate 

v 

way  of  obtaining  an  optimal  solution  is  to  rotate  T°  about:  kern(T). 

a 

Although  the  Isbell -Marlow  does  not  implement  n  rotation  of  T^(  it 
accomplishes  the  same  end.  It.  Sweeps  across  the  feanlble  region  in  a 
direction  towards  the  optimal  solution.  1'he  procedure  can  be 
described  as  sequentially  translating  hyperp lanes  of  changing  nlopett 
until  the  optimal  extreme  point  for  (P')  i9  obtained. 

Vj 


CHAPTER  3 

HYPERBOLIC  INTEGER  PROGRAMMING 
3.1  A  CenercjJL  Algorithm 

Problem  (Pp  with  X'  bounded  implies  that  the  number  of 

feasible  integer  points  is  finite.  Thus  it  is  possible  to  view  (I’p 

aa  «  special  case  of  (Pp  which  is  discussed  in  Section  2.2. 

Theorem  1  and  Corollary  1.1  together  with  the  observation  that 

max  >_  0  providoei  the  basis  for  an  algorithm  to  solve  (Pp .  Such 

x*  c  X' 
x'  Integer 

an  algorithm  ia  given  below. 

Algorithm  HIP(l) 

1.  Find  any  feasible  integer  point  belonging  to  X'.  Call  the  point 
Xq  and  set  j«l. 

2.  Define  the  following  linear  integer  program: 

max  (z.  «  (d '  x '  ,  J  3 )  ( c '  x '  -I-  a)  -  (c'x!  .  +  c<)(d'x'  +  6)} 
j  "  "J-1  ~  ”  - J"1  - 

s.t.  x’  e  X’ 

x'  integer 

3.  Solve  the  problem  defined  in  step  2  by  eny  convenient  method . 

Call  t ho  solution  £ j  . 

A.  If  max  Zj  “  0|  st.opi  otherwise  let  j  j+1  and  return  to  step  2. 

The  convergence  of  HIP(l)  depends  solely  on  having  a  finite, 
number  of  feasible  integer  points  ns  possible  optimal  solutions  for 
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(Pp .  For  convenience,  it  is  assumed  that  the  number  of  feasible 

integer  points  is  k.  By  construction,  the  algorithm  generates  a 

sequence  of  points  (x! }  such  that  f(x!)  K  € (x? . . )  Vi.  If  there  exist 

w'l  "t.  —  — 1+1 

some  finite  index  j  such  that  f(x')  “  f(x!.,),  it  follows  that 

-j+1 

*-j+p2ij+p  “  0.  Appealing  to  Corollary  1.1,  and  x^+^  arc  optimal 
hyperbolic  solutions.  Xn  implementing  the  algorithm,  the  worst  that 
can  happen  is  that  HIP(l)  will  generate  all  k  feasible  integer  points 
such  that  f(xp  <  f(xp  <  ...  <  f  (x£) .  By  the  nature  of  H1P(1),  it 
must  be  that  at  the  next  iteration  f (x^)  ■  *  tefc+P  *  0nce  again, 
appealing  to  Corollary  1.1,  it  follows  that  x^  and  x^+^  are  optimal 
hyperbolic  solutions.  The  boundedness  of  X’  insures  that  (Pp  has 
a  finite  number  of  feasible  integer  points.  Thus  if  HIP(l)  is  used 
to  solve  (Pp,  the  optimal  solution  will  be  obtained  in  a  finite 
number  of  steps. 

3.2  Discussion 

The  choice  of  the  point  x^  In  F.TP(l)  merits  further  discussion. 

To  be  sure  that  an  objective  function  is  generated  at  step  2  when 

J"l,  it  is  only  necessary  to  impose  the  restriction  that  (c'x^  +  a) 

and  (d_'x^  +  6)  are.  not  zeio  simultaneously.  In  addition,  the  point 

x^  need  not  be  feasible  anrl  it  need  not  be  integer.  If  x^  is  not 

feasible,  f (xp  is  not  necessarily  a  lower  bound  for  the  maximum  of 

the  hyperbolic  objective  function.  It  should  be  clear  however  that , 

xp  the  solution  to  the  first  linear  integer  program  in  H1P(1)  is 

feasible  for  (Pp  and  furthermore  max  f(x')  >  f(xp.  The  worst  that 

x'  t  X’ 
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can  happen  x^  la  not  feasible  Is  that  convergence  of  HIF(l)  ;'s 


•lower}. 


\ 


Choosing  x^  with  integer  components  is  not  necessary  but  is 
desirable  if  an  all  integer  cutting;  plane  method  is  used.  If  the 


cons 


Lant  t! 


erm.3  a  and  8  are,  not  both  equal  to  zero,  it  is  convenient 


to  choose  the  null  vector.  If  a  “  B  ■  0,  a  first  feasible 

integer  point  can  be  found  in  one  of  several  ways.  For  example,  a 
solution  to  the  problem  ^ 


max  {z  “  l*x' } 

\ 

s. t.  x*  e  X' 

x'  integer 


\ 

can  always^  be  used  as  x^.  If  the  hyperbolic  integer  program  is  a 


maximization  problem,  it  is  often  reasonable  to  expect  the  solution  to 

1  1 

the  problem 


max  {z  *“  c/x.' } 
s.t.  x'  e  X' 


x'  integer 


to  yielr.  a  near  optimal  point  for  (Pp.  Solving  this  problem  is 


clearly  another  meens  fo)  choosing  in  HIPf.l). 

One  of  the  interesting  aspects  of  the  algorithm  HIP(l)  is  that 
its  convergence  depends  solely  on  having  a  finitb  number  of  feasible 
points.  Special  cases  of  (Pp  fall  into  this  category  and  have  been 
considered  by  other  authors.  For  example,  when  the  components  of  the 
solution  vector  x'  arc  restricted  to  be  (C-l)  variables  and  X  '(h 
(defined  by  pseudo-boolean  equation^,  II  if  (1)  reduces  to  an  algorithm 
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\ 
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similar  to  the  one  proposed  by  Roblllard  end  Florien  [20],  When  the 
feasible  region  is  defined  by  a  set  of  linear  inequalities  and  there 
is  no  i;  tegev  restriction  on  the  solution  vector,  HIP(l)  reduces  to 
ar  algorithm  similar  to  the  one  proposed  by  Isbell  and  Marlow  [16]. 

i 

Thus  tjhe  same  algorithm  which  la  used  to  solve  an  integer  problem 
can  also  be  used  to  solve  a  continuous  problem.  This  is  best 

explained  by  the  fact  that  the  splution  to  (P^)  lies  on  at  least  one 

\ 

of  the  extreme  poinfcn  of  the  feasible  region,  I  Finding  the  optimal 

solution  to  (Fg)  can  therefore  |be  limited  to  a  search  of  the  Extreme 

'  -  I  |  I 

points  of  X'.1  Under  the  assumptions  made  here,  the  number  of  1 

extreme  points  is  finite  and  hence  in  this  sense  (P*)  is  a  special 

\  c  ; 

case  of  (P*).  Therefore,  H1P(1)  can  be  used  to  solve  (P')  and, 

r  *  ,.i  c  i 

finite  convergence  is  insured.  , 

With  rngnrd  to  integer  programming,  H1P(1)  is  general  enough 

\  ' 

to  solve  the  problem  I 

max  (f(x')  ■  (c'x'  +  cO/Cd'x*  +  S)}  . 

a.:.  x'  t  jx'  1 

X.’  Integer  .  (Pi) 


where  X*  is  an  arbitrary  bounded  convex  set  with  integer  points  in  its 
Interior.  The  ease  with  which  (P^)  can  be  solved  depends  on  how  easily 
each  c  ,<»  of  the  aubproblems  can  be  solved.,  In  the  case  when  the 

I 

feasible  region  is  defined  by  parabolic  constraints,  the  method  of  , 
Witaigall  [21]  can  be  used  to  solve  the  subproblems.  If  X*  is  an 
arbitrary  convex  set  with  integer  joints  in  its  ihterlop,  the  cutting 
plane  tnlthod  of  Kelley  [22]  can  be  used  to  solve  the  integer  aubproblems. 
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The  algorithm  HIP(l)  is  clearly  much  more  general  than  it  first  appears. 
It  will  be  shown  later  that  HIP(l)  can  also  be  used  to  solve  a  hyper¬ 
bolic  group  problem. 

3.3  Alternate  Optimal  Solutions 

Having  obtained  an  optimal  solution,  say  xj^,  for  (Pp ,  the  set 
of  alternate  optimal  solutions  coincides  with  all  the  feasible  integer 
points  which  lie  on  the  following  hyperplanes 

{x'  I  (d 'x;  +  B)(c.'x’  +  o)  -  (c'xj,  +  +  B)  “  0} 

For  the  special  case  when  in  (pp  a  •  $  »  0,  the  next  result  can  be 
useful  for  generating  alternate  optimal  solutions. 

lemma  3 

If  in  (Pp  a  “  B  *  0  and  if  xj^  is  an  optimal  solution  then  if 
k  is  a  positive  rational  number  such  that  kx*  is  integer  and  kxj^  c  X' 
then  kxj,  is  an  alternate  optimal  solution  for  (Pp. 

Proof! 

When  a  ■  B  *  0,  f(x' )  -  ic,x'/d.'x' .  It  follows  immediately  that 
the  optimal  objective  function  value,  f(x^)  *  c/x^/d'xj  remains 
unchanged  if  numerator  and  denominator  arc  respectively  multiplied  by 
a  positive  rational  number  k,  Therefore  if  kxj'  t  X'  and  if  kx^  is 
Integer  it  is  also  optimal. 
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3.4  Reducing  the  Constraint  Set 

It  was  noted  earlier  that  if  the  point  xj  is  a  feasible  integer 
point  for  (Pp  then  f(xj)  is  a  lower  bound  for  the  maximum  of  the 
objective  function  value  in  (Pp.  This  implies  that 


<i'*j  +  B)^'  +  <0  -  (c’xj  4-  aJ(dV  +  e>  >  0 


(3.1) 


ia  a  valid  constraint  for  the  (j+l)th  sijbproblem  in  the  general 
algorithm.  A  natural  modification  of  ilfi P(l)  is  therefore  to  redefines 

i 

the  feasible  region  for  each  aubproblerj.  Let 

XJ+1  -  l]  n  Tj  u  tJ 

whore  X*  “X*,  T°  is  the  hyperplane  defined  in  (2.3),  and 

T*  “  (x*  |  (d'xj  4-  0)(.c'n'  +  Ci)  -  (jc’xj  4*  a)(d  'x'  +  0)  >  0} 

The  set  described  by  is  nothing  more  than  the  original  constraint 

act  with  the  additional  constraint  (3.1). 

Trauth  and  Woolsuy  [23]  have  reported  that  bounding  constraints 
such  an  (3.1)  have  helped  to  speed  convergence  for  certain  linear 
intogur  programs  which  wore  not  tractable  previously.  Whether  or  not 
bounding  constraints  such  as  (3.1)  will  help  to  speed  the  convergence 
of  HIP (1)  remains  to  be  soon.  It  is  of  some  interest  to  note  that 
(3.1)  Ik  implicit  hi  the  original  statement,  of  HIP(l)  end  is  therefore 
a  redundant  onnst  mint  . 

It.  Is  now  ohowu  I  h  ii  t  for  the  infill  Hod  vuralon  of  llll'(l),  the 
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optimality  condition  Zj(Xj)  •  0  1*  equivalent  to  the  condition 

X'  -  Xl,  By  construction  X*  a  x ! ,  furthermore  if  x!  an  optimal 

*j  Ti  J  J 


eolution  and  Zj(xj)  “  °i  it,  follows  that 


T>  "  *j 


TjUT^n  X*  &  —  j 


By  definition  -Xj+1  -  T"  U  n  Xj  and  it  follows  that 


v-'  7* 


Therefore,  if  is  optimal  X_j  “  — j+1* 

3.5  Cutting,  Plane  Algorithms 

Cutting  plane  methods  for  solving  the  linear  integer  programming 
problem  were  suggetited  by  Dantzig,  Fulkerson  and  Johnson  [24]  and 
formalized  by  Gomory  [25].  The  principle  behind  these  methods  is  to 
reduce  the  original  feasible  region  without  eliminating  any  feasible 
integer  points  and  then  to  reoptimize  the  objective  function  on  the 
reduced  feasible  set.  If  the  reoptimization  phase  yields  an  all 
integer  solution,  it  is  alHo  optimal.  For  the  linear  integer  program, 
Qomory  [25]  accompliahoH  this  by  generating  new  const  mints  from 
exiBtlng  constraints  and  then  reoptimizes  the  objective  funotlon  with 
the  aid  of  the  dual  simplex  algorithm.  The  f ini  tenons  of  thin  algorithm 
is  insured  it'  the  mitring  plmu'ti  are  general «ul  according  to  Goinory 'a 
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A  desirable  characteristic  belonging  to  the  Gomory  cuts  is  that 
they  can  be  generated  systematically  from  an  optimal  noninteger  tableau 
as  well  as  from  a  nonoptimal  dual  feasible  tableau. 

In  the  next  few  sections,  a  class  of  algorithms  which  can  be 
viewed  as  a  synthesis  of  the  Martos  [ 2 ]  algorithm,  the  Isbell-Mar low 
C 16]  algorithm,  Gomory  cutting  planes  and  Lemke's  dual  simplex  method 
of  linear  programming  is  developed.  Alternately,  this  class  of 
algorithms  can  be  viewed  as  a  special  case  of  HIP(l). 

3.6  Gomory  Cuts 

In  the  context  of  linear  integer  programming,  a  Gomory  cut  is 
an  inequality  derived  from  an  existing  constraint  and  must  be 
aatisfied  by  any  integer  solution.  UTten  added  to  the  original  Bet  of 
constraints,  this  inequality  reduces  the  original  feasible  region 
without  excluding  any  feasible  integer  points. ^  The  cutting  planes 
can  be  derived  in  the  following  manner.  Denote  by  [x]  the  largest 
integer  less  than  or  equal  to  X.  If  x  is  any  number  and  >.  is  any 
positive  number,  it  follows  that 

x/X  -  tx/X)  +  rx/x  (3.2) 

where  0  <  r  , ,  <  1.  Equation  (3.2)  can  be  rewritten  as 
—  x/X  1 

x  -  [x/X ] X  +  rx  (3.3) 

_  ^Gomory' a  fractional  and  all  integer  cuts  reduce  the  feasible 
set  X'  by  cutting  off  the  current  extreme  point  if  it  is  not  integer. 
Since  the  optimal  solution  to  the  continuous  hyperbolic  program 
occurs  at  an  extreme  point  of  X/  ,  the  possibility  of  developing  a 
cutting  plane  algorithm  becomes  evident. 
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where  0  £  rx  <  X.  At  iteration  t,  the  ith  basic  variable  can  always 
be  expressed  in  terms  of  the  nonbasic  variables.  That  ie 


xi  “  “to  +  l  (3.4) 

1  jcN  3 

where  N  is  the  index  set  for  the  current  nonbnsic  variables.  Using 

0.3) 


xj  -  x*  •  1  -  xj  U1/X]X  +  r[} 


t 


Substituting  (3.5)  into  (3.4) 


(3.5) 


x*  -  {[1/Ml  +  rjl  xj 


[sJ0/>]  +  r 


t 

iO 


l 

JeN 


UaJj/MX 


+  r 

Collecting  and  rearranging  terms, 


5j>  <-*}> 


(3.6)  becomes 


(3.6) 


x 


t 

i 


+  l 

JeN 


t  t 

Yu 


>.UaJ0/M 


+  I  i»J4/>.i(-x5)  +  [i/x]  (*xj) } 

JeN  13  3 


(3.7) 


By  definition,  the  left-hand  side  of  (3.7)  must  be  nonnegative.  The 
term  in  brackets  on  the  right-hand  side  is  required  to  be  an  integer 
and  furthermore  it  must  be  nonnegative.  This  can  be  seen  by 
letting 


8  -  [*fn/M  +  l  [aJ./XK-xb  +  [l/XH-xJ)  (3.B) 

JeN  3  3  1 


Suppose  a  la  a  negative  integer.  A  choice  of  X  such  that 
X  >  (r£0/~s)  >  0  implies  that  (r*Q  +  Xi)  <  0.  This  is  a  contradiction 
since  it  implies  that  the  left-hand  side  in  (3.7)  is  negative.  The 
inequality  b  >  0  is  therefore  an  appropriate  cutting  plane.  For  the 
special  case  when  X-l,  (3.8)  reduces  to  the  Gomory  fractional  cut  and 
when>  X  >  1  it  reduces  to  the  Gomory  all  integer  cut. 

3 . 7  Some  Background 

Before  proceeding  to  a  discussion  of  cutting  plane  algorithms 
for  solving  (P*),  some  results  regarding  the  continuous  hyperbolic 
programming  problem  are  reviewed. 

Theorem  2  (Martoft  [23 .  Porn  [17]) 

If  in  (Pg)»  the  feasible  region  X  is  bounded,  and  if 

(d_  x  +  0)  >  0  Vx  e  X,  the  optimal  solution  to  (Pc)  occurs  on  at  least 

•«» 

one  extreme  point  of  X. 

The  algorithm  of  Martos  is  based  on  Theorem  2.  The  Theorem 
suggests  that  the  optimal  solution  can  be  obtained  by  performing  an 
extreme  point  search  similar  to  the  simplex  algorithm  of  linear 
programming. 

Geometrically,  the  simplex  algorithm  of  linear  programming  is 
initiated  by  examining  any  extreme  point  of  the  feasible  set  X.  If 
the  extreme  point  is  optimal,  it  ia  recognieed  as  such  and  if  it  is  not, 
rules  are  available  for  moving  to  an  adjacent  extreme  point  which  also 
improves  the  objective  function  value.  If  no  improvement  is  possible, 
the  algorithm  terminates.  To  see  how  these  same  ends  are  attained  for 


the  hyperbolic  program,  let 


*  ‘£A  +  8 


"  -  Vb  +  « 


The  subscript  B  denotes  the  current  basis  and  Xjj  denotes  the  current 
feasible  solution.  \ 
respectively,  become 


1  2 

feasible  solution.  Via  a  change  of  basis,  the  new  values  of  z  and  z  , 


“1  1  a,  1  \ 

z  *  i  -  0(*j  “  Cj) 

2  2  9 

*  -  *  -  e<zj  -  V 

where  0  is  a  positive  constant. ^  The  quantities  (zj  -  c^)  and 
2 

(Zj  -  dj )  arc  the  respective  relative  costs  associated  with  numerator 
and  denominator  of  the  hyperbolic  objective  function.  Clearly,  for 
an  improved  objective  function  value,  the  following  condition  must 
hold : 

10  10 

(3.9) 


1.  2  „  -1.-2 
z  ft  <  «  /z 


To  determine  whether  or  not  the  condition  given  in  (3.9)  is  satisfied, 
it  is  useful  to  define  the  following  quantity: 


1,  2  ,  .  2.1  v 

tj  "  e  («j  -  dj)  -  z  (z  -  Cj) 


(3.10) 


The  condition  in  (3.9)  implies  that  an  improvement  in  the  hyperbolic 


(1) 


The  constant  6  is  computed  exac< ly  as  in  the  simplex  algorithm 


of  linear  programming.  That  is  G  -  min  y^  >  0). 
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objective  function  Value  cart  occur  only  if  there  exist  some  nonbeoic 
column  of  the  constraint  matrix  A  for  which  tj  >  0.  If  in  addition 
0  >  0,  a  strict  Improvement,  occurs.  Note  that  the  condition  0  >  0 
is  always  true  if  x„  >  0  VB,  Clearly,  problems  of  degeneracy  in 

*  D 

hyperbolic  programming  are  analogous  to  degeneracy  problems  in  linear 
programming.  This  being  the  case,  Mattoa  [2]  points  out  that 
hyperbolia  cycling  which  might  result  from  hyperbolic  degeneracy  can 
usually  be  resolved  with  the  aid  of  Chstne'a  perturbation  method.  To 
continue  with  the  Martas  algorithm,  if  tj  ^  0  for  all  nonbaeic  columns, 
the  current  solution  cannot  be  Improved  by  moving  to  an  adjacent 
extreme  point. 

Theorem  3  (Dorn  [17]) 

A  local  maximum  for  a  hyperbolic  programming  problem  is  also 
a  global  maximum. 

Appealing  to  Theorem  3,  if  tj  <_  0  V j ,  the  solution  is  also  optimal. 

The  algorithm  of  Martos  is  demonstrated  with  an  example  in 
Appendix  A. 

3.8  A  Fractional  Cutting  Flans  Algorithm 

In  this  discussion,  the  fractional  cutting  plane  algorithm  for 
(Pj)  is  viewed  as  a  special  case  of  the  algorithm  HIP(l),  Thu  first  step 

is  to  choose  a  feasible  point,  not  necessarily  an  integer  point,  and  con¬ 
struct  a  linear  integer  program  whose  solution  is  feasible  for  0’^).  In 

this  algorithm,  the  feasible  point  iB  the  optimal  solution  for  (P^)  and 

it  in  obtained  by  using  the  column  tableau  fur  Martas'  algorithm  (see 


Appendix  A),  If  the  solution  displayed  in  the  optimal  tabliSU  itt  all 
integer,  it  is  also  optimal  for  (P^).  If  it  is  not,  a  Gomory  fractional 
cutting  plane  can  be  generated  from  the  optimal  representation  of  the 
constraint  seti  Appending  a  legitimate  cutting  plane  to  the  optimal 
hyperbolic  tableau  does  not  exclude  any  feasible  integer  points  and 
thus  a  reoptimization  oL'  the  enlarged  tableau  can  lead  to  the  optimal 
integer  solution.  Unfortunately,  the  Gomory  fractional  cutting  plane 
destroys  the  primal  tableau  and  there  is  no  analog  of  the  dual  simplex 
method  for  the  hyperbolic  programming  problem  which  can  be  used  to 
reoptimize  the  tableau. 

Primal  feasibility  can  however  be  regained  by  solving 

max  U  »  (i  £*  +  5)  (c  k  +  a)  -  t_c  ;<A  +  a)  (d  k  +  0) } 
s .  t .  Ax  ■  b 

x  _>  0  and  integer  (PI) 

where  is  the  extreme  point  of  the  feasible  set  which  maximizes  the 
continuous  hyperbolic,  program.  (PI)  is  solved  using  Gomory' s 
fractional  algorithm.  This  requires  first  obtaining  the  optimal  tableau 
for  (PI)  without  the  Integer  restriction.  This  tableau  in  available 
without:  any  additional  work  if  the  algorithm  of  Martros  wit'll  the  column 
tableau  i.H  used  to  solve  (Pc).  To  see  this,  let  the  optimal  functional 
value  of  the  numerator  be 

*  *•(£><*  +  c.) 

and  similarly  lot  the  optimal  functional  value  of  the  denominator  bo 
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*2  **  (d  + 

1  2 

Substituting  z  and  *  in  (PI)  and  partitioning  the  vector  x  into 
a  basic  and  a  nonbasic  component,  the  objective  function  in  (Pi) 
becomes 

*  -  *2 <£,£],  +  S#N  +  <dB2iB  +42^  +  6) 

The  basic  vector  x^  is  eliminated  using  the  relation 

xB  “  B-1(b  -  Nx^) 

This  yields 

*  "  *2[(cBB“1b  +  a)  +  (c^  -  ic.bB''1N)xn)  - 

*1K4B“1b  +  0)  +  (4  ”  d^N)^]  0,11) 

When  B  is  an  optimal  basis  for  (Pg),  (3.11)  reduces  to 

z  «  { 21  (cL^li"1  -  dN)  -  z2(c_bB“1N  -  cN))  XN  (3.12) 

The  components  of  the  vector  in  brackets  are  easily  recognized  as  the 
quantities  t^  defined  in  (3.10).  Moreover  they  are.  the  optimal  t^'s 
and  hence  t^  5  0  VJ  e  N,  This  implies  that  the  optimal  relative 
coats  for  the  continuous  version  of  (PI)  are  exactly  equal  to  the 
optimal  tj’s*  An  optimal  basis  for  (P^,)  is  therefore  also  optimal  for 
the  continuous  version  of  (PI).  To  obtain  the  complete  optimal 
tableau  for  the  latter,  it  is  only  necessary  to  append  a  row  corresponding 
to  (3.12)  to  the  optimal  hyperbolic  tableau,  A  cutting  piano  in  alao 
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appended  to  the  tableau  and  the  linear  objective  function  is  reoptimized 
via  the  dual  simplex  algorithm.  This  procedure  la  repeated  until  an 
all  integer  solution  for  (PI)  is  obtained.  It  is  interesting  to  note 
that  the  noninteger  optimal  objective  function  value  for  (PI)  is 
zero.  This  implies  that  the  first  Gomory  cut  Is  never  generated  from 
the  objective  function  row. 

In  addition  to  the  optimality  condition  given  in  step  4  of 
HI?(1),  an  optimal  solution  for  (P^)  can  also  be  recognized  with  the 
aid  of  the  following  sufficient  condition: 

Lemma  4 

If  the  quantities  t^  are  computed  from  the  optimal  tableau  for 

(PI)  and  t.  <_  0  Vj,  the  current  solution  is  also  optimal  for  the 

J  ~~  ■> 

hyperbolic  integer  program. 

Proof i 

After  (PI)  is  solved,  the  reduced  feasible  region  can  be 
expressed  as  the  intersection  of  a  finite  number  of  hyperplanes.  In 
particular,  the  feasible  region  is  X^  where  is  the  region 

defined  by  the  Gomorv  cuts  used  to  solve.  (PI)  and  ■  X,  From  the 
Gomory  cut  properties,  it  follows  that  X.^  and  X^  Sj  contain  exactly 
the  same  integer  points.  Thus  appealing  to  tile  Martos  algorithm,  if 
tj  <_  0  Vj ,  the  solution  to  (PI)  :Ls  also  optimal  for  (P^). 

If  <  0  Vj ,  T°  is  a  supporting  hyporplane  to  X^  at 

x^  and  x^  is  also  optimal  for  (Pj).  If  there  exist  tj  > 


0  for  some 


J  e  N»  it  i«  still  possible  for  the  current  solution  to  be  optimal  for 
(F^).  To,  see  if  this  is  indeed  the  caset  the  following  problem  in 
formulated. 

max  {z  -  (i*i  +  8)(c  x  +  #)  -  (c  x^  +  ct)(d  x  +  S) } 
s.t.  x  c  ^  n  s1 

x  Integer  (P2) 

The  optimal  solution  to  (P2)  is  again  obtained  by  using  Gomory’a 
fractional  algorithm.  The  noninteger  solution  which  is  obtained  first 

A  h  ft 

is  called  x^.  Note  that  the  hyperplane  *(x^)  ■  (d  +  B)(c  +  a)  - 
(c  Xj  +  a)(<i  x*  +  3)  is  parallel  to  T®.  Thus  if  a  cutting  plane 
algorithm  is  used  to  solve  (P2),  a  new  integer  extreme  point  on  the 
Integer  hull  contained  in  the  original  feasible  region  is  obtained  or 
an  integer  point  lying  on  T°  is  obtained.  If  the  latter  occurs,  z(x^) 
and  Xj,  which  is  the  optimal  solution  to  (P2)  is  also  optimal  for  (P^.), 
If  the  solution  to  (P2)  does  not  lie  on  T°  and  there  exist  some  »  0, 
a  new  linear  integer  program  is  defined  and  the  procedure  is  repeated. 
A  statement  of  the  fractional  cutting  plane  algorithm  is  now  given 
below.  The  following  definitions  will  be  useful. 

X j  »  X  “  {xjAx  "  *  i  0) 

'v  feasible  region  for  Jth  linear  integer  program 
Sj  •v  region  defined  by  Gomory  cuts  used  to  solve  jth  linear 


integer  program. 
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Algor:! 


1.  Disregard  the  integer  restriction  and  solve  (Pj.)  using  the  column 


tableau  version  of  the  Martos  algorithm  (see  Appendix  A).  Call 


the  solution  x*.  If  the  solution  is  all  integer  stop;  otherwise 


let  j  »>  1  and  xn  ■  x^. 


2.  .Define  the  following  linear  integer  program: 


max  {z  *  (d  x.  ,  +  8)(c  x  4-  a)  -  (ex.  .  I  a)  (d  x  +  0)! 
3  - j“i  -  — - 


s.t.  x\c  X, 


x  integer 


where  ■  X 


ij  *  2L,  x  n  bj.j  for 


3.  Solve  the  problem  in  step  2  using  Gomory's  fractional  algorithm. 


Call  the  solution  Xj- 


4.  If  max  2^  «=  0  or  if  <_  0  Vj  e  N  stop;  otherwise  let  j  ■  j+1 


return  to  step  2. 


Although  HIP (2)  is  clearly  a  special  case  of  HIP(l),  it  is  alsi> 


in  the  same  spirit  as  Gomory' s,  fractional  algorithm  for  the  linear 


integer  program.  That  is,  the  optimal  extreme  point  for  (P  )  is 


obtained  first.  If  the  solution  is  integer,  the  procedure  terminates. 


If  1 t  is  not,  a  cutting  plane  which  cuts  off  the  current  extreme  point 


and  which  does  not  delete  any  feasible  Integer  points  is  appended  to 


the  original  feasible  region.  The  objective  function  is  then  reoptimized 


on  the  reduced  feasible  set.  New  cutting  planes  are  generated  until 


the  reoptimization  phase  yields  an  extreme  point  of  the  integer  hull 


WiMiwwWJWWw 


contained  in  X.  What  makes  (T'j)  more  difficult  to  solve  than  the 

i 

linear  integer  program  is  thut  more' than  one  extreme  point  of  the 
integer  hull  may  have  to  be  generated  before  the  optimality  condition 


is  satisfied.  Clearly  since  X  is  assumed  boundedjj  the.  integer  hull  has 
a  finite  number  of  extreme  points.  At  moW  HIP (2)  will  generate  all 
of  these  an^  since  f(xjj+1)  ^  ffx^)  Vj,  HIP (2)  will  converge  in  a 
finite  number  of  steps.  \ 

Although  conceptually  tie  same,  HIP(l)  and  HIP (2)  do  have  some 

differences.  In  HIP(2),  the  feasible  region  is  reduced  at  each 

'  \ 

iteration  whereas  in  H1P(1)  the  feasible  region  remains  the  same  at 
each  iteration.  Because  of  the  nature  of  cutting  plane  algorithms, 

HIP (2)  only  searches  points  which  lie  within  the  boundary  of  the 
original  feasible  region  and  which  are  outside  or  on  the  boundary  of 
the  integer  hul?  contained  in  the \ original  feasible,  region.  This  is 

-  1  i  !  i  |  . 

not  nece  laarily  the  ease  with  HIP(l)  if  a  branch  and  bound  ^lgorithni 
is  used  to  solve  each  of  the  linear  integer  programs.  A  special 
property  of  HIP(2)  is  that  the  optimal  tableau  for  the  Jth  linear 
integer  problem  with  some  slight  modification  becomes  the  initial 
tableau  for  the  (J+l)th  problem.  This  simply  mean^  that  when  solving 

the  (j+l)th  problem,  it  is  not  necessary  to  start  from  the  beginning. 

\ 

\  ! 

1  The  cutting  plane  algorithm  described  here  is  implemented  with 
the  aid  of  the  tableau  format,  shown  in  Table  1.  The  entries  in  the 
first  ji ow  are  the  * s  (J  e  N)  which  determine  the  optimality  of  the 
hyperbolic  program.  They  a^e  computed  after  each  integer  solution  is 
obtained  according  to 


TABLE  1 
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Appealing  to  Lemma  4,  the  current  solution  is  optimal* 

Lemma  5  implies  that  if  >  0  VJ  e  N  then  increasing  any  one 
of:  the  original  variables  to  a  positive  level  will  decrease  the 
objective  function  value.  If  there  exist  j  r  N  such  that  a^  <  0,  the 
Initial  tableau  is  primal  feasible  with  respect  to  the  relative  costs 
displayed  in  the  z-row.  It  is  not  however  dual  feasible.  As  in 
H1P(2),  the  first  step  is  to  find  a  feasible  integer  point  for  (P  ). 

In  addition,  an  all  integer  tableau  is  to  be  maintained  at  each  itera¬ 
tion.  Each  of  these  objectives  is  achieved  if  the  linear  objective 
displayed  in  the  z-row  is  maximized  using  either  a  primal  cutting  plane 
algorithm  or  Gomory's  all  integer  algorithm.  If  a  primal  cutting 
plane  algorithm  is  used,  the  fit  at  pivot  can  be  made  without  altering 
the  first  tableau.  If  the  Gomory  all  integer  algorithm  is  used,  the 
current  tableau  must  first  be  rendered  dual  feasible  with  respect  to 
the  relative  costs  of  the  linear  objective  function.  This  is 
accomplished  by  appending  the  constraint 


xn+m+l 


M 


(3.13) 


to  the  current  tableau  and  choosing  it  as  the  pivot  row.  The  pivot 


column  is  chosen  as  the  lexicographically  smallest  column  with  respect 
to  the  current  linear  program.  The  constant  M  in  (3.13)  is  an 
arbitrarily  large  integer  such  that  *n+ni+^  i  0.  The  constraint  given 
by  (3.13)  simply  expresses.!  the  fact  that  the  original  constraint  set 
is  bounded.  A  pivot  at  this  point  will  result  in  an  all  integer  dual 
feasible  tableau.  A  statement  of  the  all  integer  algorithm  is  given 


below. 


This  is  the  same  index  defined  in  (3.10).  The  entries  in  the  Becond 
row  identify  the  nonbasic  variables  at  the  current  iteration.  The  N 
and  D  rows  represent  the  numerator  and  denominator ,  respectively.  The 
entry  n^g  is  the  current  numerator  value  and  dgg  is  the  current  denomina¬ 
tor  v&lue.  The  i  row  denotes  the  current  linear  objective  whose  integer 
solution  is  being  sought.  Rows  x^  through  are  the  current  nonbaaic 
variables  and  rows  x  through  x  are  the  current  basic  variables. 

The  last  row  is  for  the  Gomory  cut.  The  use  of  HIP (2)  is  demonstrated 
with  sn  example  in  Appendix  B. 

$.9  An  All  Integer  Cutting  Plane  Algorithm 

In  this  section,  s  cutting  plane  algorithm  based  on  the  Gomory 
all  integer  cut  is  developed.  The  algorithm  is  a  special  case  of 
HIP (1)  and  is  started  by  displaying  the  problem  in  the  column  tableau 
format  (see  Table  1).  The  entries  in  the  z-row  are 


Lemma  5 


fl00  " 

fl0j  “  “n00d0j  +  n0jd00  V;3  E 


The  optimal  hyperbolic  function  value  is  (a/p)  and  the  optimal 
integer  solution  is  £  ■  0  if  >_  0  Vj  e  N. 


By  definition  t  ^  «  -a^  Vj  .  Thus  if  a^j  >  0  V  j ,  tj  0  Vj  . 


Proof : 
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Algorithm  HIP (3) 


1.  Set  up  the  column  tableau  for  the  hyperbolic  program  as  in  Table  1, 
The  components  of  the  vector  are  *•  0  (i**l>...,n)  and 

xn+j,0  “  bj  O”1*  •  •  •  <"0  •  Set  J"1- 

2.  Generate  the  following  linear  integer  programming  problem: 


max 


i  { JSj  “  (d  x^^  +  $)<£  x  +  a)  -  (£  +  a)  <d  X  4  B)} 


s.t.  x  e  _Xj 

x  integer 
where  *  X 


h  ■  h-i " s 


j-i' 


3>  Option  A;  Solve  the  problem  defined  in  step  2  using  a  primal 
cutting  plane  algorithm.  , 

Option  B:  Append  the  constraint  given  by  (3.13)  and  pivot  to 
render  tableau  dual  feasible  with  respect  to  the  relative  ca9ts 
in  Che  z-row.  Use  the  Gomoty  all  integer  algorithm  to  maximize, 
the  linear  objective  function. 

4.  Compute  tj  Vj  e  N.  If  t^  <_  0  Vj  e  N  or  if  Zj(Xj)  e  0  stop; 
otherwise  let  j  *  j +1  and  return  to  step  2. 


Since  HlP(3)  is  a  special  case  of  HIP  (1) ,  the  finiteness  proofs 
are  the  same.  It  should  be  pointed  out  that  when  implementing  HIF(3) 
with  option  B,  the  constant  M  in  (3.13)  must  be  chosen  with  some  care. 
It  is  important  to  realize  that  a  constraint  of  the  form  (3.13)  must 
be  appended  every  time  a  linear  integer  program  is  generated.  Since 
the  set  of  nonbasic  variables  changes  for  every  linear  integer  program, 
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•  constant  H  which  is  large  enough  £ or  the  first  problem  may  not  be 
large  enough  for  the  second  problem.  This  simply  rneanB  that  the  constant 
may  have  to  be  changed  at  each  iteration.  Certainly,  if  it  is  chosen 
large  enough  at  the  outset,  it  need  never  be  changed. 

The  use  of  HIP (3)  is  demonstrated  with  the  use.  of  an  example 
in  Appendix  C. 

j 

3. 10  A  Variant  of  the  Fractional  Cutting  Plane  Algorithm 

This  algorithm  is  initiated  in  precisely  the  same  way  as  HIP (2). 
Tho  counter  index  is  set  equal  to  one  and  the  first  three  steps  are 
repeated.  If  t,  <_  0  VJ ,  the  current  solution  1b  also  optimal  for  the 
hyperbolic  pregram.  If  there  exist  t^  >  0  for  some  ]  £  N,  this 
algorithm  me  tes  use  of  the  fact  that  f(Xj)  is  «  lower  bound  for  the 
maximum  of  the  hyperbolic  objective  function.  In  other  words,  the 
integer  solution  must  satisfy  the  following  constraints 

(d  x,  +  B)(c  x  +  a)  -  (c  x.  +  a)(d  x  +  B)  >  0  (3.14) 

- j  -  - 3  -  ~ 

The  strategy  in  this  algorithm  is  to  append  (3.14)  to  the  current 
tableau  and  use  the  Martos  algorithm  to  reoptimize  it.  This  step 
yields  the  optimal  hyperbolic  extreme  point  for  the  cux*rent  feasible 

region.  If  the  optimal  solution  has  all  integer  components,  the 

k 

algorithm  terminates.  If  it  does  not,  Let  x^  denote  the  optimal  hyper¬ 
bolic  noninteger  extreme  point  and  generate  the  following  linear 
integer  program: 


rl  p 

max  (zj+1  -  (d,  Xj  +  3)  (c  x  +  a)  -  (c  +  ct)(d  x  +  ?)) 


whore  X, 


..t.  *  c  Xj+1 

x  Integer 
«+ 


TT  (j**l,2,,..  ).  The  „jlution  to  tu- b 


. . , .  -  x.  s.  t:  t° 

-j+i  -J  J  j  J 

problem  Is  either  optimal  for  the  hyperbolic  integer  program  or  it  is 


an  improved  lower  bound.  The  algorithm  is  described  below. 


Algorithm  HIP (4) 

1.  Solve  (Pj)  disregarding  the  integer  restriction.  If  the  solution 
is  all  integer,  stop}  otherwise  set  x^  “  x  and  j*»l, 

2.  Define  the.  following  linear  integer  program*. 

w  A 

max  tZj  *  (jd  Xj„i  J<r  3) 'c  n  a)  -  (c  +  a)(d  x  +  B)} 

s.t.  x  e  Xj,  x  integer 
where  Xj  "  X 

V  Vi  n  Vi  n  TJ-i  u  Tj-i  3-2.s.... 

3.  Solve  the  problem  defined  in  step  2  using  Gotnory’s  fractional 
algorithm.  Call  the  solution  jK ^ . 

A.  If  tj  <_  0  Vj  £  N  or  if  f(x^_^)  “  £(Xj)  stop;  otherwise  go  to 
step  5. 

5.  Use  the  Martos  algorithm  to  reoptimize  the  current  tableau.  If 
he  resulting  solution  is  integer,  stop;  otherwise  let  x*  be 
the  optimal  extreme  point  and  let  j  *  j+1  and  return  to  step  2. 


J+l 


The  feasible  region  X 


is  defined  by  appending  the  constraint 
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given' In  (3.14)  to  the  optimal  tableau  for  the  jth  linear  problem. 

This  constraint  is  only  kept  on  the  tableau  for  the  (j+l)th  problem 
and  is  discarded  thereafter.  The  reason  for  this  is  that  when 

(d  Xj+1  +  8)  (c.  x  +  a)  -  (e  +  c.)  (d_  x  -t  8)  >,0 

is  appended  to  X  fi  Sj+i»  t^ie  resu^c  is  that  X  ^  ^j+l* 

The  algorithm  HIP (4)  can  be  helpful  when  it  is  desirable  to 
terminate  at  some  near  optimal  integer  point.  Note  that  the  quantities 

)|f 

f(x^)  and  f (x j )  are  respectively  lower  and  upper  bounds  for  the  maximum 
of  the  hyperbolic  function.  ThuB  the  quantity  6  ■  f  (sc, )  -  f(x  )  1  0 

J  J 

is  a  measure  of  how  close  is  to  the  optimal  integer  solution,  When 
x_j  is  optimal  fi  -  0.  A  stopping  rule  is  therefore  to  compute  5  and 

^  A 

stop  when  6  <_  6  where  6  is  user  specified.  ’ 

HIP (4)  converges  in  a  finite  number  of  steps  because 
ILj+i  ^  Kj  VJ  and  the  number  of  feasible  integer  points  contained  in 
X_j+^  is  at  least  one  less  than  the  number  of  feasible  integer  points 
contained  in  X j .  Hence  in  the  worst  case  there  exist  some  finite 
iteration  K  such  that  X^  contains  exactly  one  integer  point.  Since 
by  virtue  of  H1P(4)  f(Xj+^)  f(Xj)  it  follows  that  when  there  is 
only  one  integer  point  left  in  the  feasible  region  f(x,,. )  “  f (x , ) . 

— j+i 

Optimality  is  therefore  achieved  in  a  finite  number  of  steps. 

3.11  Group  Theoretic  Approach  to  Hyperbolic  Integer  Programming 

In  this  section,  it  will  be  shown  that  the  group  theoretic 
approach  used  to  solve  the  linear  integer  program  can  also  be  used  to 


*olv«j  (Pj).  It  will  be  necessary  however  to  wake  the  additional 
assumption  that  when  disregarding  the  integer  restriction,  the  optimal 
value  of  the  numerator  is  greater  than  or  equal  to  *ero,  This  is  not 
restrictive  in  an  economic  context  since  the  numerator  is  usually  a 
cost  function.  Before  proceeding  to  the  hyperbolic  group  problem,  a 
brief  review  of  the  group  theoretic  aspects  of  linear  integer  programming 
is  given. 

The  linear  integer  programming  problem  is  of  the  form 
max  { i  *  c  x) 

•w 

a. t.  x  c  X 

X  integer  (LPj) 

where  X  is  defined  exactly  as  in  (Pj).  The  group  optimiration  problem 
associated  with  (LPj)  is  generated  by  first  solving  (LPj.)  without 
the  integer  restriction,  This  makes  it  possible  to  partition  the 
constraint  matrix  A  into  a  sot  of  optimal  basic  columns  B  and  a  set 
of  optimal  nonbasic.  columns  N.  This  partitioning  is  always  possible 
if  the  simplex  algorithm  is  used  to  solve  (LP^,).  Partitioning  the 
solution  vector  accordingly,  the  constraint  equation  can  be  written  os 

Bxd  +  %N  -  b 

Expressing  the  basic  vector  x^  in  terms  of  the  nonbasic  vector 
and  multiplying  the  objective  function  by  (-1),  (LPj)  can  be 


reformulated  as  follows! 
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min  it  »  *‘cB8":lb  -  ( 
s .  1 1  "  B  1(b  *»  Nx^) 

*D*  2%  L  0  and  integer  (LP1_) 

The  term  (-CyB  H>)  which  appears  in  the  objective  function  is  constant 

and  therefore  the  problem 

min  {**  “  -(Cy  - 
B.t.  x^  >  B^b  -  Nxn) 

x b»  Kji  I  0  and  integer  (l.P?.^) 

has  the  same,  solution  as  (l.Pl^).  Furthermore  all  the  costs  in  the 
objective  function  are  nonnegative.  This  1b  a  consequence  of  the 
optimality  criterion  used  in  the  simplex  algorithm.  If  the  non¬ 
negativity  restriction  on  xB  is  dropped,  problem  (LP2j)  becomes 

min  {z  ■  -(c.t  -  c„B  ^N)x.,} 

— N  -  -J)  —• N 

s.t.  B  ^Nx.  l  B  Jb  (mod  1) 

■— tI  — 

x^  _>  0  and  integer  (LP3j.) 

yif  ^  1  A  A 

It  is  important  to  note  that  if  x^  minimires  z  ,  (B  (b_  -  need 

A 

not  be  feasible  for  (LP2T).  Although  the.  vector  xu  will  be  all  integer 

A 

if  is  all  integer,  it  need  not  have  a] 1  positive  components. 

Gomory  [26]  shows  that  i f  (b.  -  Nx^)  ii®s  in  the  cone  generated  by  the 

-1 

columns  of  B,  then  x„  ■  B  (b  -  Hx.,)  >  0.  Hence  there  exists  a  class 
“~u  —  -*N  — 

of  problems  such  that  the  solution  to  (LP3^)  will  always  generate  a 


feasible  solution  for  (l.P2j). 
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The  algorithms  which  attempt  to  solve  (l .Pj)  via  (LP3j)  neglect 

the  nonnegativity  restriction  on  x^,  If  the  solution  to  (LP3j) 

generates  a  feasible  solution  for  (tPj)  it  can  be  shown  that  the 

solution  is  also  optimal  If  the  solution  is  not  optimal,  special 

methods  must  be  used  to  generate  alternate  solutions. 

The  group  structure  underlying  (LPj)  wbb  observed  in  (LP3j)  by 

Gomory  1 26 ] .  The  main  results  are  summarized  here.  Denoting  the 

module  of  all  integer  points  in  m-space  by  M(I)  and  denoting  the  module 

of  integer  combinations  of  the  columns  of  B  by  M(B)  Gomory  shows  that 

the  factor  module  G  *  M(I)/M(B)  1b  a  finite  additive  group  of  D 

elements  where  D  “  jdet  B|.  Furthermore,  the  positive  fractional  parts 

~1  -1 

of  the  columns  of  the  matrix  (B  N,  B  t>)  generate  a  finite  group  F 

with  the  group  operation  addition  modulo  1.  Similarly,  the  positive 

fractional,  parts  of  tha  rows  of  the  same  matrix  generate  a  finite 
T  T 

additive  group  F  .  The  groups,  G,  F  and  F  are  related  by  the  fact 
that  they  are  all  isomorphic  to  each  other.  The  group  structure  imbedded 
in  the  constraints  allows  (LP3^)  to  be  viewed  as  a  knapsack  prcbjtm 
which  must  be  optimized  in  the  group  G.  Algorithms  itfhich  take  advantage 
of  the  group  structure  of  (LP3^)  have  been  proposed  by  Gomory  [26],  White 
[27],  Hu  [28],  Glover  [29],  Shapiro  [30]  and  Hefley  [31]. 

It  will  now  be  shown  that  it  is  possible  to  proceed  as  In  the 
case  of  (LPj)  and  generate  a  hyperbolic  group  problem.  The  Martos 
algorithm  is  first  used  to  solve  (P_) .  This  makes  it  possible  to 
partition  the  constraint  matrix  into  a  set  of  optimal  basic  columns  B 
and  a  set  of  optimal  nonbasic  column  N.  Since  B  is  nonsingular 
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H-l 


xB  -  B  (b  -  N4) 

Thus  the  basic  vector  4  can  be  eliminated  from  (P^)  by  direct 
substitution*  This  yields 


max  fCx^)  ■* 


(Cfl  ~  £bb"1n)>%  +  teg6"1*  *  a) 
<4  -  dgB'^x*,  +  (dBB_1b  +  0) 


s.t.  Xg  “  ®  A(b.  -  NXjj) 

4*  4  *.  0  and  integer 


<*V 


As  a  matter  of  convenience!  the  following  definitions  are  made 
to  simplify  the  statement  of  (Plj). 

a1  -  CgB-1^  4-  a 
*2  ■  +  8 

%  ’  %  -  £eb"1" 

4  ■  4 ' 4b'1n 


Upon  proper  substitution,  (Plj)  becomes 

,  4%  + ,1 

m>:  f  (Xf,)  -  -s— - — J 
i#N  +  ' 

n.t.  4  -  B’  ^(b  -  N4) 


xB,  4  0  and  integer 


(PZj) 


Dropping  the  nonnegativity  restriction  on  4,  (P2^ )  becomes 


4a 


£mSn  +  * 

•nax  f(iO  -  - s' 

44  +  2 

s.t.  b'"1Nx^  5  B_1b  (mod  1) 

x^  >,  0  and  integer  (P3j) 

The  group  structure  present  in  the  constraint  of  (LP3j.)  is  also  present 
in  the  constraint  of  (P3j).  This  follows  from  the  fact  that  the  optimal 
solution  to  (P^,)  occurs  on  an  extreme  point  of  X  and  hence  can  be 
characterized  by  some  basis  B.  The  constraint  in  (P3j.)  can  therefore 
be  viewed  as  ona  constraint  which  must  be  satisfied  in  a  finite  additive 
Abelian  group.  Furthermore ,  the  condition  which  insures  that  an  optimal 
solution  for  (LP3j.)  generates  a  feasible  and  therefore  optimal  solution 
for  (LPj)  also  holds  for  the  hyperbolic  case.  That  is,  if  (b  -  Nx^) 
lies  in  the  cone  generated  by  the  columns  of  the  optimal  basin  B  then 
xfi  ■  B,  1(b  -  Nx^)  ^  0.  Thus  there  exists  a  class  of  hyperbolic  problems 
such  that  the  optimal  solution  to  (PS^)  will  always  generate  a  feasible 
and  therefore  optimal  solution  for  (P^).  This  c,-*lss  of  problems  is 
analogous  to  the.  asymptotic  linear  integer  programming  problem. 

It  will  now  be  shown  that  an  optimal  solution  for  (P3j.)  can  be 
obtained  by  adapting  the  general  algorithm  HIF(l)  discussed  in  Chapter  3. 

It  will  bo  useful  to  first  prove  the  following  result. 

Lemma  6 

A  2 

Let.  Xjj  be  any  feasible  solution  for  (P3j)  such  that  (d^  +  z  )  >  0. 

Then 

/  *  1  .  2v  1,  2 

<£v*n  +  z  )  t NxN  +  z  )  <  z  /z 


Proof : 


Suppose  the  contrary  is  true.  That  is 


,  *  .  1.  '  2.  1,2  1 
Cc^  +  Z  +  2  )  >  Z  /2 


ff  2 

Because  (cL-x*.  +  a  )  >  0 


1 


2  A  1  1  *  2 

2  (SflSjj  +  2  >  -  2  <4%  +  2  >  >  0 


or  equivalently  1 


U2(cn  -  cbB-1N)  -  2^4  -  d3B'4)}  xN  >  0 


The  components  of  the  vector  in  'brackets  are.  the  quantities  t^  which 

are  computed  in  the  llartos  algorithm  to  check  optimality.  The  basis 

B  being  optimal  for  (P^X  it  must  be  that'  t.  <  0  Vjj  e  N.  A  contra- 

,  >- 

diction  is  therefore  obtained  and  the  Lomma  is  proved. 

Lemma  6  indicates  how  a  feasible  Integer  point  can  be  found 

•  '  ! 

for  (PJ^).  It  is  obtained  by  solving  the  following  problem: 


r  ,  2  *  l.*v  , 

max  U  *  (z  cN  -  z  d^)x^.) 
s.t.  b"1Nxv  v  B“1b 


(mod  1) 


21  0  and  integer 


This  problem  Is  equivalent  to  the  problem, 

\ 

min  [z  B  l  (-t.)x.} 
jcN  3  3 

)  s.t.  b“1NxN  •:  B_1b 

_>  0  and  integer 


(mod  1) 


(GP1) 


1 
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\ 


where  is  defined  in  (3.10).  Sinie  B  is  optimal  for  (P^), 

\ 

tj  0  VJ  t  N.  (GP1|  is  a  grr  ip  knapsack  problem  and  can  be  solved  by 
any  available  algorithm,  If  the  Martos  algorithm  had  terminated 
injtegar,  the  solution  to  (GPl)  would  be  ^  ■  0  VJ  t  N  and  thfe  optimal 
objective  function  would  be  zero.  If  on  the  other  hand,  it  did  not 
terminate  integer,  the  solution  to  (GPl)  provides  a  lower  bound  for 
the  maximum  of  the  hyperbolic  objective  function.  Thus  if  there  exists 

I 

a  better  integer \point  than  the  one  which  ia  optimal  for  (GPl),  it 

'  \  , 

must  yield  an  objective  Tunctioh  value  which  lias  in  the  interval 


,<1) 


+  zVz*]  where  y^lf  is  optimal  for  (GPl). 

The  existence  of!  r.uch  a  point  can  bo  established  by  considering  the 


.1,2, 


,u> 


problem 


max  {(djjx*15  +  +  «*)  “  +  2‘)  +  *‘)> 


* 


2. 


s.t.  B*‘1Nx,.  5  B-1b  I 

_>  0  and 'integer 


(mod  1) 


(GP?) 


An  equivalent'^  problem  for  (GP2)  is  obtained  by  multiplying  the  objective 
function  by  (-1).  After  rearranging  terms,  the  problem  becomes 

min'^z^cj^x^  4-  z1)  -  r1(d^x^1^  +\  z2) 


+  t<44J>  + 1?)4  ‘  (441}  +  z2)4v 


s.t.  B“1NxM  =  B“1b 
—N 


(mod  I) 


_  0  and  integer 


(GP3) 


The  strategy  for  finding  a  sequence  of  feasible  integer  points 
which  improve  the  objective  function  cf  is  reviewed.  First  on 
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uppor' bound  for  the  objective  function  ie  vised  to  generate  a  group 
knapoack  problem.  The  solution  to  this  problem  provider  a  lower 
hound  for  the  maximum  of  the  objective  function.  It  now  remains  to 
determine  whether  or  not  there  exist,  a  feasible  integer  x^  such  that 


,  *  x  K 
<£#N  *  } 


ro rr~ 
+ 


2. 
t  ) 


(c,pt.,  i  Z^)  1 

_ <  jl. 

+  2  >  * 


This  tan  b«  accomplished  b/  using  the  lower  bound  in  this  lent  inequality 
to  generate  a  new  group  knnpaock  problem.  This  problem  has  tha  same 
structure  ae  (GV2),  If  it's  optima?  objective  function  value  is  strictly 
greater  then  aero,  an  improved  solution  for  (lJ3j)  hns  been  found.  If 
the  optimal  objective  function  value  Is  urro,  the  current  solution  is 
tiso  optimal.  A  ststemant  of  the  algorithm  J.o  given  below’, 


1,  Solve  the  hyperbolic  program  using  tho  Marcos  algorithm.  It  the 
algorithm  terminates  with  an  integer  solution,  stop;  other"! sc*  gc 
to  step  2. 

2,  Dee  the.  optimal  t^'r.  and  formulate  the  problem 


nlv.  },'  (-t.)x. 

JrN  ->  J 

“•1  *1 
«.t.  B  Nx.,  E  B  b 
r"N 


(mod  1 ) 


0  and  Integer 


Solve  using  any  aval  (able,  algorithm  and  >11  tho  solution  x 


CD 


~N 


^  /  j  S  *) 

'  1-  as**)  _<  0,  stop;  otherwise  not  j"’l  and  continue . 


If 
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3.  Formulate  the  problem 
min  {F(*1+1)  - 


8.  t.  B"1^,  =  B^b 
—N 

^  >0  and  integer 


(mod  1) 


where  »  z2(Cj*jx^  +  z*)  -  4*  ai2).  Solve  using 


(J+l) 


If 


any  available  algorithm  and  call  thrt  solution  x^ 

A  (i+i)  2 

(d^x^  1  +  z  )  <_  0*  stop |  otherwise  continue. 

A.  If  *j  o,  the  current  oolution  is  optimal  for  (P3^)j 

otherwise  set  j  -  J+l  and  return  to  step  3. 

An  example  ia  solved  with  HIP (.3)  in  Appendix  D. 

To  prove  that  HIF(b)  converges  in  a  finite  number  of  stops, 
each  linear  group  problem  must  have  a  finite  solution.  For  the  time 
being,  this  will  be.  assumed  to  be  the  case.  Thin  assumption  will  be 
studied  in  greater  detail  later  on.  Furthermore,  it  must  suffice  to 
consider  only  a  finite  number  of  feasible  points,  To  see  that  this  i 
the  case  when  each  linear  group  problem  is  finite,  notn  that  each 
group  problem  has  exactly  the  same  constraint.  That  is 


b“1Nk.,  s  B~3b 
~N 

x^  >  0  and  integer 


This  constraint  can  also  be  written  as 


(mod  1) 


l  Vi  "  80 

icN  3  3 


a.  >0  Vi  c  N 
1  ” 


where' Vi  c  N  and  are  elements  of  a  finite  Abelian  group  with 
addition  modulo  D  “  jdet  B|.  If  the  vector  with  components  x^,  i  e  N, 
ie  a  solution  for  a  linear  group  problem  then  the  vector  with  components 
(x^  4  n^D),  i  c  N,  is  also  a  feasible  solution.  In  other  words 


l  B^Cx  4  n  D)  -  g 
icN  A  1  1  u 

Furthermore  if  the  vector  with  components  x^,  i  e  N,  la  an  optimal 

solution  for  the  group  problem  then  all  vectors  with  components  of  the 

a 

form  (x^  4  rt^D)  i  e  N  yield  worse  objective  function  values  than  vectors 
with  components  x^ .  Thus  if  given  a  feasible  solution  vector  with  some 
component  x^  >  D,  it  is  always  possible  to  construct  a  better  solution 
by  replacing  by  x!  with  0  <_  xj  <  (D  -  J.) .  ThiB  can  alwuys  be 
accomplished  by  subtracting  the  largest  possible  multiple  of  D  that 
will  keep  x|  positive.  It  follows  therefore  that  an  optimal  solution 
to  the  linear  group  problem  must  have  0  <  x^  j  (D  -  1)  Vi  e  N  and 
the  feasible  region  for  each  linear  problem  con  therefore  hit  bounded, 

'the  discussion  tbun  far  implies  that  if  euch  linear  group 
problem  generated  by  H1V(S)  is  finite,  its  solution  con  be  obtained  by 
considering  only  a  finite  number  of  points.  Furthermore  the  finite 
number  of  fans.' bln  points  is  exactly  the  same  for  each  linear  group 
problem.  Hacalling  HIP(5),  at  any  iteration,  either  there  is  a  strict 
improvement  in  t.Vio  hyperbolic  objective  function  or  the  solution  is 
repeated.  If  the  solution  is  repeated (  it  is  also  optimal.  The 
algorithm  terminates  in  a  finite  number  of  steps  bucauac  only  finitely 
man;,  feasible,  points  are  considered . 
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The  assumption  that  each  linear  group  problem  has  a  finite 
solution  is  now  examined  in  greater  detail.  FiniteneBS  of  every 
linear  group  problem  is  insured  if  ell  the  components  of  the  vector 
[  (c^Xjj  +  z  )d^  -  Cd ;  +  *  )c^]  are  nonnegative  at  each 
iteration.  To  find  the  conditions  when  this  is  true  suppose  that  for 


some  j  one  of  the  components  is  negative.  That  is 

<44J)  +  zl)dj  -  (44J)  +  *2,cJ <  °  (3ti5) 

Since  +  z^)  >  0,  (3.15)  can  be  written  as 

<cJxjSJ)  +  +  22)  •  d*  <  c*  (3.16) 

(3.16)  is  an  equivalent  statement  for  (3.15).  Thus  whenever  (3.16) 

leads  to  a  contradiction,  (3.15)  must  be  nonnegative.  Firbt  suppose 

^  A 

dj  -  0,  Appealing  to  (3.16),  c^  >  0.  Recalling  that  <_  0  at 

the  optimal  continuous  hyperbolic  solution,  a  contradiction  is  obtained 

2  a  1  A  A  A 

since,  t.  «*  z  c.  -  z  d.  >0.  When  in  (3.16)  d,  <  0,  either  c.  >  0 

J  J  J  j  j  ~ 

*  *  * 

or  Cj  <  0.  When  <  0  and  >  0  a  contradiction  is  obtained  since 
t^  >  0.  When  d^  <  0  and  Cj  <  0,  (3.16)  implies 


*  (4)  i  *  f-O  2  *  A 

(%V;  -t  2  )/(dN4  +  O  >  (-‘jJ/t'V 


(3.17) 


Lemma  6  together  with  (3.17)  implies  that 

1,2  ,  A  * 

z  /z  >  (-c.  )/(-d  ) 

J  J 

2  * 

Since  z  0  and  ( — cl ^ )  >  0,  i  t  follows  that 

?  A  1  a 
z  c.  -  Z  d,  >  0 
i  i 

A  contradiction  is  achieved  since  (3.18)  implies 


>  0. 


(3.18) 
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If 

The  last  case  to  consider  Is  when  >  0.  First  suppose 

ft  /  j  \  n  it 

+  z  )  ^  0.  This  implies  >  0  and  (3.16)  can  be  written  as 


+  z2) 


*  ,  * 
‘  c3/dJ 


(3.19) 


Appealing  to  Lemma  6,  (3.19)  implies  either 

.)  <44J)  +  +  «2>  i  .v.2  <  cj/d 


* .  .*> 

i 


or 


b) 


(%4J)  +  ^/(djx*^  +  <  cj/dj  41  *1/z2 


If  a)  occur b,  once  again  tj  >  0  and  a  contradiction  is  obtained.  If 
b)  occurs,  (3.15)  is  true,  and  hence  the  linear  group  problem  has  an 
unbounded  solution,  If  is  feasible  for  the  hyperbolic  group 

problem,  feasibility  is  maintained  by  replacing  the  j th  component  of 
the  solution  vector  by  (x^  ^  +  nD) .  Therefore  b)  implies  that  if  n 

approaches  infinity,  the  hyperbolic  function  for  the  group  problem 

*  * 

approaches  (c ^ ) / (d ^ )  in  the  limit.  Letting  n  get  very  large  implies 
that  the  jth  nonbasic  variable  will  get  very  large.  Thus  there  exist 

some  n'  such  that  if  n  >  n'  feasibility  will  be  violated  in  (P^.), 

*  *  (i)  1  * 

how  suppose  dj  >  0  and  (.c^x^  +  z  )  <  0.  This  implies  <  0 

and  (3.19)  still  holds.  Thus  the  argument  given  above  can  he  repeated 
for  this  case. 

The  algorithm  HIP (5)  can  therefore  terminate  in  several  ways. 

If  all  the  linear  group  problems  are  finite,  HIP(5)  converges  in  a  finite 

number  of  steps.  If  the  solution  is  feasible  for  (Pj),  it  is  also 

>'<  2 

optimal.  If  at  some  point  in  the  algorithm  (_d  v.x  ,  +  i.  )  <_  0,  the 
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denominator  in  (P^,)  will  also  be  less  than  of  equal  to  aero,  This 

however  contradicts  the  original  assumption  that  (d_  x  +  3)  >  0 
—  *  2 

V:x  c  X.  Thus  (djjXy  4-  2  )  <_  0  implies  that  (x^,  x^)  is  not  feasible 
for  (P^)  and  the  algorithm  terminates.  If  at  some  iteration  a  linear 
group  problem  with  an  unbounded  BoLution  is  generated,  feasibility  will 
also  be  violated  in  (P^). 

One  way  to  proceed  if  the  group  problem  leads  to  infeasibility 
Is  to  generate  faces  of  the  corner  polyhedra  (see  Gomory  [26])  and 
reoptimize  the  continuous  hyperbolic  problem,  If  this  leads  to  an 
integer  solution,  it  is  also  optimal.  If  it  is  not,  a  new  group  problem 
can  be  generated  and  the  procedure  is  repeated. 

As  of  yet  there  is  no  evidence  to  indicate  whether  or  not  there 
exists  a  class  of  hyperbolic  group  problems  that  will  always  terminate 
at  step  4  of  11IP(5).  To  determine  whether  or  not  HIV(5)  is  aB  useful 
as  the  group  theoretic  solution  to  the  linear  integer  problem  will 
require  implementing  an  algorithm  and  testing  it  with  a  wide  variety 
of  problems. 


CHAPTER  4 


SOME  SPECIAL  PROBLEMS 

4.1  The  Hyperbolic  Programming  Problem  with  Bounded  Integer  Variables 
Only 

The  problem  considered  here  is 

n  n 

max  {f(x)  -  (  l  +  a)/<  £  djX.  +  B) } 

i“l  i«l 

s.t.  0  <  x^  <.  m. 

integer  Vi  (P'Bj) 

It  is  assumed  that  a  >  0,  8  >  0  and  >  0,  d^  >  0  Vi.  (P'B^)  has  a 
hyperbolic  objective  function  and  its  feasible  region  has  a  finite 
number  of  feasible  integer  points.  This  suggests  that  the  general 

t 

algorithm  H1P(1)  can  be  used  to  solve  (P'Bj.). 

If  the  feasible  region  for  (P’B^)  does  not  have  all  integer 
extreme  points,  it  must  be  that  some  of  the  upper  bounds  are  not 
integer.  Replacing  by  the  largest  integer  smaller  than  m.  will 
insure  that  the  reduced  feasible  region  has  all  integer  extreme  points 
and  furthermore  that  no  feasible  integer  points  for  the  original 
problem  are  eliminated.  A  special  version  of  H1P(1)  which  is  given 
below  can  therefore  be  used  to  solve  (P'B^). 

Algorithm  HIP (6) 

1.  Let  a^'  »  a  and  6^  ■  8.  Set  j“l. 

2.  Generate  the  following  problem: 


36 


max  {2,  -  l  ot^*"1^) 

J  i*l  1  11 

s,  t .  x^  -  0,1,...  ,tn^  Vi 

3.  The  solution  to  the  problem  in  step  2  is  obtained  by  letting 

.0-1.), 


xp*  -  m1  if  -  o' 


a^)  >  0  and  letting 


-  0  if  (B^"1)c1  -  a(;j“1)cli)  <_  0. 

4.  If  max  2^  *  0,  the  current  solution  is  optimal)  otherwise  compute 


.«>  -  1  *.*«>  + » 


6 


i»l 

«>  -  l  d.,«>  +  9 
i»l 


Let  j  »  j+l  and  return  to  step  2. 


Clearly,  H1P(6)  converges  in  a  finite  number  of  (steps  because 
it  1b  a  special  case  of  HIP(l). 

H1P(6)  is  of  special  interest  for  several  reasons.  First  note 
the  algorithm  1b  still  valid  if  the  integer  restriction  is  removed. 
Second,  the  cane  with  which  the  subproblems  cun  be  solved  makes  the 
algorithm  computationally  attractive.  Third, and  perhaps  moac  important, 
is  that  the  number  of  variables  in  each  succeeding  subproblem  decreases. 
More  particularly  once  a  variable  is  act  t;o  its  lower  bound  at  aotnc 
iterati.cn,  :lt  can  be  eliminated  from  the  problem.  To  see  that  this  is 
a  valid  step  suppose  x^  i<  net  to  zero  at  iteration  k.  This  implies 
that 


(CJ  " 


(a<k"l)/6(k"3))dJ) 


By  virtue  of  the  algorithm  however 


in.  I  -.*!■  r,*  UW.IV, 
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<«<k>/^k>)  >  <a«k“1>/»<k“1>)  k«l,2,...  (4.1) 

It  follows  therefore  that 

<Cj  -  (a<k)/0<k))dj)  <-  0 

and  the  variable  x^  remains  aero  at  the  (k+l)th  iteration,  From 
(4.1)  the  variable  x^  will  also  remain  at  its  lower  bound  in  the 
remaining  eubproblems.  The  dimension  of  the  subproblems  therefore 
decreases  at  each  Iteration.  When  no  more  Variables  can  be  eliminated 
from  a  sub problem,  the  cut rent  solution  is  also  optimal. 

Also  of  interest  Is  that  (P'Bj)  can  be  viewed  as  bivalent 
problem.  That  is  each  variable  can  assume  only  one  of  two  Values. 

This  becomes  apparent  once  the  structure  of  the  solution  is  known. 

If  (P'Bj)  is  viewed  as  a  bivalent  problem,  an  algorithm  proposed  by 
Hammer  and  Kudeanu  (32]  can  also  be  used  to  solve  the  problem. 

The  Hammer  and  Hudoanu  algorithm  differs  from  HIP (6)  in  that 
ir,  builds  a  list  of  active  variables  whereas  HTP(6)  starts  with  the 
largest  possible  list  of  active  variables  and  reduces  it  at  each 
iteration. 

An  example  is  used  to  demonstrate  IllP(G)  in  Appendix  E. 

4.2  The.  Hyperbolic  Knapsack  Problem 

In  this  section,  the  linear  fractional  or  hyperbolic  knapsack 
problem  is  studied.  Thin  problem  ban  the  following  form: 

t>  n 

max  (f(x)  "  (a  +  )_  c^x^J/Cfi  +  }  d^x^)} 

l."l  i«.l 

» 

s.t.  J  <  b 

i~l 
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_>  0  and  integer  (P^) 

In  thia  discussion,  it  will  be  assumed  that  a  >  0,  6  >  0  and  c.^  >  0, 

d^  >  0  Vi.  To  insure  that  (P^)  has  a  bounded  feasible  region,  it  will 

also  be  assumed  that  a.  >  0  Vi. 

i  — 

(P^)  is  of  special  importance  because  it  arises  in  many  models 
and  Bradley  [33]  has  recently  shown  hew  to  reduce  m  linear  constraints 
into  one  equivalent  linear  constraint  for  integer  problems. 

Since  (P^)  has  a  bounded  feasible  region,  its  solution  can  be 
found  by  specializing  HIP(l).  Such  an  algorithm  is  given  below. 


Algorithm  HtP(7) 


1.  Let  '•  a  and  8^  -  8.  Set  j«l, 

2,  Generate  the  following  problem! 


U,  -  I  +  (bW-”.  - 

J  i-1  1  1  * 


t*  l  «xj)  < 


x^  >_  0  and  integer 

3.  Solve  the  linear  knapsack  problem  by  any  convenient  method  and 
call  the  solution  x  . 


A.  If  max  if, .  >  0  let 

.1 


( 1 )  V  C J 

tt  J  -  «  +  2  c.x." 

i-1  1  1 

B(J)  -  3  +  l  d  x 
i-1  1  1 


"fcJrgf  -its'.iV  ’ -‘“If  -i_:L‘  i  |  ‘  i  ‘ 


1 


lift.- 


i-l 


Set  J  •>  j+1  and  return  to  step  2.  If  max  z^  “  0  stop.  The 
current  solution  is  optimal. 

HIP  (7)  will  converge  to  the  optimal  solution  of  (P^)  in  a 
finite  number  of  steps  because  it  is  a  special  case  of  H1P(1).  More 
important,  for  exactly  the  same  reasons  given  in  Section  4.1,  once  a 
variable  is  set  equal  to  it  lower  bound  it  can  be  eliminated  from 
the  rest  of  the  subproblemB  generated  by  the  algorithm.  Thus  HIP (7) 
generates  a  sequence  of  linear  knapsack  problems  which  decrease  in 
the  number  of  variables.  When  the  number  of  variables  can  r.o  longer 
be  decreased,  the  current  solution  is  also  optimal. 

The  result  presented  in  this  section  can  also  be  extended  to 
continuous  hyperbolic  programming  problems  with  positive,  constraint 
matrices.  That  is  if  the  matrix  A  in  (Pc)  is  positive,  the  number  of 
variables  in  each  linear  problem  generated  by  HIP ( 1 )  can  be  decreased 


at  each  iteration. 


CHAPTER  5 

SOME  COMPUTATIONAL  RESULTS,  SUMMARY  AND  CONCLUSIONS 

5.1  Computational  Experience 

The  computational  experience  reported  here  is  based  on  an 
experimental  computer  code  for  the  all  integer  cutting  plane  algorithm 
HIP(3).  The  computer  program  was  run  on  an  IBM  360/65  and  is  based  on 
R.  E.  Woolsey'a  [34]  IPSC  code. 

To  determine  the  difficulty  of  the  test  problems,  the  number  of 
iterations  required  for  the  first  linear  integer  problem  generated  by 
H1P(3)  wore  compared  to  the  iteration  statistic  for  (P^),  The  number 
of  linear  integer  programs  which  had  to  bo.  Bolved  before  an  optimal 
solution  for  (Pj)  was  recognized,  was  also  recordod. 

The  test  problems  were  constructed  so  that  the  first  problem 
generated  by  HIP(3)  was  a  linear  integer  problem  of  known  difficulty. 
That  is  if  the  problem 

max  (fix’)  «  cV/(d.V  +  1)} 
s.  t.  A'x/  _<  b 

x.'  i*.  0  a i'd  integer  (U'Tj) 

is  solved  with  the  aid  of  11  IP (3),  the  first  subprohlem  is 

max  {  Zy  "  c_' x/  } 

B.t.  A'x/  <  b 

x*  >_  0  and  integer 
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The  linear  functionals  appearing  jin  the  numerator  of  (^'Tj)  were  taken 
from  Trauth  and  Woolsey  [35].  The.  components  of  the  vector  were 
chosen  arbitrarily.  The  test  problems  and  solutions  obtained ^via 
HIP (3)  are  given  in  Appendix  F.  The  results  are  summarized  In  Table  2. 

I  \ 

Based  on  a  sample  of  14  test  problems,  the  averlage  number  of 
linear  integer  problems  which  had  to  be  solved  1 0  reach  optimality  was 
2.9.  Problem  4  did  not  converge  but  a  lower  bound  for  the  maximum  of 
the  objective  function  valuej was  obtained  after  62  iterUctions . ^  In 
.12  out  of  IT  test  problems  which  converged,  the  optimal  solution  was 
available  before  it  was  recognized.  Problem  9  was  the  exception.  '  When 
the  optimal  solution  woo  available  before  it  was  recognized,  the  average 
numbeV  of  additional  iterations^  required  to  identify  the  solution 

l  '  \ 

was  10.9.  The  average  numbur  ,of  iterations  to  (solve  the  first  linear 
problem  is  46.2  and  the  average  number  of  iterations^  to  solv^e  the 

hyperbolic  problem  is  349.3.  Using  iterations^  bb  a  criterioli,  the 

!  1 

average  test  problem  is  7,6  times  moie  difficult  than  the  first  linear 
problem.  This  number  is  considerably  reduced  however  if  problems  2,  3 
and  5'aro  deleted  from  the.  sample. 

i  1 

5.2  Summary  and  Conclusions  j 

In  Chapter  2,  it  was  established  that  uhe  solution  to  (P')  car. 

Lj 

V 

bu  obtained  by  rotating  a  hyperplnne  about  an  (n-2)  dimensional 
subspaco  in  E  .  i 

I 

^^Iterntion  as  it  is  used  here.,  is  in  the  context  of  the 
Gomoty  All-Integer  algorithm. 

t 


eneces  optimal  solution 
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'  In  Chapter  3,  a  general  algorithm  for  solving  CP.J.)  (or  (Pj)) 
vhich  r»!quir«s  solving  a  finite  sequence  of  linnar  Integer  program.') 
was  proposed.  It  woe  also  shown  that  this  general  algorithm  can  be 
used  to  solve  the  more  general,  problem  (P^). 

Cutting  plane  algorithms  were  also  studied  in  detail.  These 
algorithms  were  viewed  as  special  cases  of  the  general  rlgorl thm  11IP(1). 
Because  the  optimal  solution  to  (P‘)  lies  on  at  least  one  extreme 
point  of  the  feasible  region,  the  cutting  plane  algorithms  are  in  the 
spirit  of  Gomory’s  fractional  and  all-integer  algorithms.  That  1e, 
if  the  solution  to  (P')  is  riot  all  integer,  a  cutting  plane  which 

V> 

cuts  the  current  extreme  point  Ip  appended  to  the  constraint  set  and 
the  objective  function  is  reoptimiced  on  the  reduced  feasible  set. 

Tbit)  procedure  is  repeated  until  on  all-integer  solution  is  obtained. 

In  the  worst  case,  a  cutting  plane  algorithm  will  generate  all  the 
extreme  points  of  the  integer  hull  contained  in  the  original  feasible 
region.  Note  that  if  the  original  matrix  is  totally  unlmodular,  the 
solution  tc  (P')  is  all  integer  and  hence  also  optimal  for  (Pi).  In 

v  i- 

this  case  cuts  never  have  to  he  added. 

Based  on  the  geometry  of  hyperbolic  programming,  the  solution 
to  (Pp  can  also  be  obtained  by  rotating  a  hyperplnna  about  an  (n-2) 
dimensional  subapnee  in  En.  Although  the  algorithms  derived  from 
HiP(l)  oo  not  implement  rotations  directly,  they  achieve,  the  same  thing. 
An  equivalent  procedure  fer  rotating  a  hyperpiano  about  an  (n-2) 
dimensional  oubspace  of  En  untlu  it  hits  a  point  is  to  first  move 
T?  parallel  to  itself  in  the  direction  cf  y^  until  it  hits  x^*  The 


1 

n 

i; 

f§  second  step  ie  to  construct  ft  hyperplene  Tj  which  peases  through  the 

a®  (n-2)  dimensional  aubepace  and  the  point  Xj*  Clearly  the  end  result 

'W 

fin  is  a  rotation  of  through  a  positive  angle,  the  final  position  of 

H  the  hyperplane  being  Algorithms  derived  from  HTP(l)  selectively 

'qtr 

i|  determine  finite  sequences  of  hyperplanes  to  bn  translated.  This 

1 

1  procedure  continues  until  the  optimal  solution  !e  recognized.  j 

Mj  In  Chapter  3,  it  1b  also  shown  that  the  group  theoretic,  approach  ■ 

\m 

B  can  be  used  to  solve  (Pj)  (or  (F^)).  This  result  depends  on  the  fact 

p'. 

1  that  the  solution  to  (P^,)  can  be  expressed  in  terms  of  an  optimal 

B 

I  basis.  A  hyperbolic  group  problem  in  obtained  and  it  is  shown  that  tf 

Bit' 

1 

m 

|  the  solution  to  (P^)  exists,  the  group  problem  has  a  bounded  feasible 

K  ■ 

|  region.  This  makes  it  possible  to  specialize  H1P(1)  for  solving  the 

a  hyperbolic  group  problem.  A  useful  consequence  of  the  group  theoretic 

-  ill 

|  approach  in  that  the  master  polyhedral  generated  by  Gonory  [?.6]  for 

« 

|  solving  the  lir  ?r  integer  program  can  be  used  for  solving  (P^)  . 

|  In  Chapter  4,  twe  special  problems  were  considered.  A 

K 

T 

|  hyperbolic  problem  with  bounded  integer  variables  only  was  discussed 

v~p 

|  first.  An  algorithm  for  solving  the  problem  which  makes  it  possible 

I  to  decrease  the  number  of  variables  at  each  iteration  is  proposed. 

I  The  second  “pocial  problem  is  a  hyperbolic  knuost.ck  problem.  It  is 

Ki 

i 

B; 

|  shown  that  the  solution  to  this  problem  can  b;  obtained  by  solving  a 

BBfc: 

| 

HI 

I  firiitu  sequence  of  linear  knapsack  problems  decreasing  in  the  number 

1 

P  of  variables  at  each  iteration. 

1 

1  5.3  Further  Kesonrch  and  Extensions 

m 

|  The  most  obvious  extension  of  this  work  is  with  regard  to 

V" 

J 

Bfc 

1 

fKjjkUdu 

6? 


mixed-intafcer  programming.  For  example,  can  a  partitioning  procedure 
ar>  suggested  by  Benders  [36]  for  the  linear  mixed'*integer  problem  be 
implemented  to  solve  the  problem 

mast  { f (x,i)  -  (c^x  +  £2X-  +  Q) / (<!]£.  +  d_o-v- 

s.t.  Ajx  +  A^i.b 
x  >  0 

y  _>  0  and  integer 

Another  open  area  with  regard  to  this  problem  is  the  cutting  plane 
approach. 

The  Generalized  Lagrange  Multiplier  approach  of  Everett  also 
is  worthy  of  consideration  with  regard  to  (P^)>  This  method  is  useful 
when  the  constraints  are  not  binding  to  the  degree  indicated  by  the 
problem  statement.  The  resulting  problem  has  a  very  special  structure 
and  indicates  that  special,  algorithms  may  be  derived. 

The  structure  of  the  hyperbolic  group  problem  also  seems  to 
indicate  thet  specie.]  algorithms  can  be  obtained  for  solving  this 
problem,  An  interesting  question  which  arises  is  whether  there  is  a 
network  interpretation  for  the  hyperbolic  group  problem. 

Further  research  also  needs  to  be  done  to  establish  the 
efficiency  of  hyperbolic  integer  programming  algorithms.  This  of  course 
necesa.i  tates  computer  programming  efforts  to  obtain  numerical  results 
for  a  wiae  variety  of  test  problems. 
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APPENDIX  A 


MARTOS'  ALGORITHM!  AN  EXAMPLE 

A  column  tableau  with  negative  multipliers  is  adapted  for  (Pi). 
The  Martos  optimality  criterion  t^  is  easily  computed  at  each  iteration 
according  to 

Cj  "  n00d0j  "  d00n0j 

where  n^,  d0j,  d^,  and  n^  are  defined  in  Table  1.  The  format 
introduced  here  is  useful  for  implementing  cutting  plane  algorithms 
for  solving  integer  problems.  Consider  the  following  problem: 

max  {f(x^,x2)  «  Oxj^  +  3x2  +  ^/(Sx^  +  2x?  +  1)} 

s.t.  3x^  +  5x2  _<  16 
5x^  +  2x2  <_  11 
x^ ,  x2  j>  o 

Slack  variables  x,  and  x.  are  introduced  and  the  constraints 
3  A 

are  rewritten  as 

x3  -  I6  ~  3*l  -  5x2 

x,  «  11  -  5x,  -  2x„ 

A  12 

Table  3  is  a  statement  of  the  original  problem  and  Table  A  is  the 
optimal  tableau.  A  side  calculation  shows  it  was  obtained  in  one 
iteration.  The.  pivot  element  in  Table  3  is  circled. 
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APPENDIX  B 

THE  FRACTIONAL  CUTTING  PLANE  ALGORITHMS  AN  EXAMPLE 

The  example  given  in  Appendix  A  with  the  additional  reatric- 
tion  that  and  must  be  integers  is  used  to  demonstrate  HIP  (2). 
Table  5  is  the  noninteger  optimal  tableau  with  the.  z-rcw  and  Gomory 
cut  row  appended,  The  source  row  is  found  to  be  the  Xj  tow  and  the 
pivot  element  is  circled.  Pivoting  results  in  Table  6.  Calculating 
tj  VJ  e  N  at  this  point  verifies  that  the  current  solution  i9 
optimal  for  (P^). 


APPENDIX  C 


THE  ALL-INTEGER  CUTTING  PLANE  ALGORITHM t  AN  EXAMPLE 

The  example  used  In  Appendix  A  with  the  additional  restriction 
that  and  v.^  must  be  integers  Is  used  to  demonstrate  HIP (3). 

Option  B  in  step  3  is  followed. 

Table  7  is  a  statement  of  the  original  prohlem  with  the  z~row 
included.  An  additional  row  exhibiting  the  constraint 

x5  *<  20  -  x^  -  y-2 

where  20  is  an  upper  bound  on  the  sum  of  the  current  nonbasis 
variables  is  also  appended.  Table  B  is  the  dual  feasible  tableau 
with  respect  tc  the  z-row  which  results  from  the  first  pivot  operation. 
The  row  is  the  source  row  and  is  the  first  cut  appended  to  the 
original  set  of  constraints.  Reoptimizing  z  after  s^  is  appended 
yields  the  optimal  tableau  which  is  displayed  in  Table  9. 
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APPENDIX  D 


A  GROUP  THEORETIC  ALGORITHM 

The  integer  version  of  the  example  used  in  Appendix  A  is 
again  used  here.  The  first  group  knapsack  problem  which  must  be 
solved  is 

min  { (83/5)x1  +  <l/5>»3> 


3/5  ' 

1/5  ' 

x,  +  x,  ■ 

'  1/5  ' 

(mod  1) 

4/5  . 

1  3/5  3 

.  3/5 

x  ,  >  0  and  integer 

This  problem  is  easily  obtained  from  Table  4.  The  group  constraint 
is  generated  by  taking  the  positive  fractional  parts  of  the  rows 
corresponding  to  the  basic  variable  and  the  objective  function  costs 
are  (-t^)  and  The  solution  to  this  simple  problem  can  be 

found  by  inspection  if  it  is  noted  that  the  right-hand  Bide  of  the 
group  equation  is  the  name  as  the  group  element  whi ch  multiplies  the 
variable  which  has  the  smallest  cost  in  the  objective  function.  The 
optimal  solution  is  therefore,  x^  ■>  0  and  *  1.  Since  m  3  and 
-  5,  this  solution  is  also  feasible  for  the  hyperbolic  integer 
program.  Proceeding  according  to  the  algorithm  HIP(5),  the  linear 
group  problem  is  found  to  be 
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\ 


mi  tv  {-1/5  +  (78/5)x1  +  (l/5)x3) 

'  3/5  1/s  C  1/5 

s.t.  +  x„  (mod  1) 

,  A/5  3/5  J  3/5  _ 

i 

xj  *  >  0  and  integer 

1 

The  solution  to  this  problem  is  found  to  be  identical  to  the  first 
solution  and  F  «  0.  The  current  solution  is  therefore  ^lso  optical 
for  the  hyperbolic  integer  program. 
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APPENDIX  E 
HIP(6)t  AN  EXAMPLE 


I 


The  ease,  with  which  HIP (6)  can  be  implemented  is  demonstrated 
with  the  example  below. 


max 


4x,  +  x„  +  3x_  +  2x.  +  2xc  +  x,  +  3 

1  X  l _ i  4 _ o  o 

7x^  +  +  3  x^  +  3x^  +  5x^  +  2x^,  +  7 


s.t.  xx  »  0,1,2 


x?  -  0,1, 2, 3 
x3  -  0,1 


x,  “  0,1, 2, 3, 4, 5 


x5  ”  0,1, 2, 3, 4  t 


Xg  "  0,1,2 


Applying  the  algorithm,  the  first  linear  objective  to  be  maximised  is 


|  max  { /x^  +  4x^  -  3x^  +  5x^  -  x^  4-  x^}  , 

Following  the  algorithm,  the'  first  solution  is  x.  »  2,  x„  <=  3, 

i  1  * 

X-  “  0,  x,  “  5,  n.  «  0,  and  x,  *  2.  The  new  constants  in  the  second 
3  4  5  6 


problem  are  c/'  '  c  26  and  (5^ 


43.  The  variables  and  x,.  are  zero 


and  thus  are.  eliminated  from  the  remaining  problems.  The  second 
linear  objective  to  bo  maximized  Is 


max  {~20x,  17x„  +  8x,  -  9x,} 

1  2  4  6 


The  second  solution  is  therefore  x.  «  0,  x„  »  3,  x,  "  5 ,  x ,  c  0 

1  2  4  6 

and  «■  x,  *  0.  The  now  constants  in  the  third  problem  n >  •; 

1  3  6 

/  ja  /'2  s 

ci  “  16  and  p'1  )  *>  25,  and  the  variables  x^  and  x^  are  eliminated, 

The  third  linear  objective  to  be  maximized  1 m 


7  b 


wax  {9x^  +  2x^} 


Since  no  more  variables  can  be  eliminated,  the  optimal  solution  is 
Xj  ■  3,  “  5  and  “•  “  x,.  *>  x^  **  0.  The  optimal  objective 

function  value  is  (16/25). 
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SOME  COMPUTATIONAL  RESULTS 

The  computational  results  summarized  in  Chapter  5  are  based 
on  the  following  set  of  problems: 

Test  Problems 


max  £(x)  - 


20x^+18x2+17Xj+15x^+15x^+10x^+3x?+3xg+Xj+x^Q 

7~rr3~ x4+  x5vr  x6 +1^ 

s.t.  x^  »  0,1  . . . ,10 


3Ux1+25x1+20x,+18x,+17x,.+llx,+5x,+2xo+xft-tx,  n  <  b 
1  2  3  4  o  6  7  8  9  10  ~ 


Problem  1 

2 

3 

4 

5 

6  7 

8 

9 

b  55 

50 

45 

40 

35 

30  25 

20 

10 

f  r  <  a  \ 

Aj  + 

h.  + 

A3 

Wfl  X 

1 1  t  A  )  " 

3AX  + 

7A2  + 

4A3  + 

1 

S  *  t « 

A1 

+  2A2 

+  2A3 

•f  21;'x 

4  3F?  .1  B] 

2Ai 

•t  a2 

*  ZA3 

+  3F1 

+  2F2  -<•  *2 

-  Vi 


<  C 
R.,py.  o 


A1  *A2 ,A3 1 ,F2  ^  ®nc*  in,t!Bel' 


V  .  '  . 


.<••.,  I..1,  ,i  , 


I  , 


! 


I 


-  liVPTrrnn 


\ 
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Problem 

R1 

R2 

B1 

B2 

10 

6 

7 

18 

15 

11 

9 

7 

18 

17 

12 

9 

9 

21 

21 

13 

6 

8 

19 

IS 

Problem  14 

The  objective  function  for  thin  problem  is  the  same  as  In 
problems  (10-13) .  The  feasible  region  is  given  below. 


Af  +  + 


2F1  +  2F2 


<  10 


+  A3  +  2FX 


+  2F3  £  10 


A2  +  a3 


+  2F2  +  2F3  £  10 


-  8F, 


8F, 


<  0 
<  0 


-  8P3  <  0 


A1 ,A2,A3,F1,F2*F3  -  0  find  *-ntcficr 

The  solutions  to  problems  (1-9)  are  displayed  In  Table  10  and 
those  to  problems  (10-14)  in  Table  11. 
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